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ABSTRACT 

An experiment was conducted based on an information 
service for planners run in conjunction with Geo Abstracts Limited. 
Porth^eight styles of abstracting journals were produced which, 
although based on the same source material, differed in depth of 
coverage, frequency of publication, content of entry, and whether an 
index was included« One style of journal was produced with each 
possible combination of these parameters. Each style was sent for a 
trial period to four users who marked items not noted and followed up 
from each issue and completed a questionnaire at the end of the 
experiment. The results show a distinction between expressed 
preferences on the parameters studied and the styles which proved 
most useful in practice. In particular, although most users said they 
would prefer abstracts, the citation-only styles were most useful. 
The bulk of a publication appears to be an important factor in 
determining usability. The experiment also demonstrated a demand for 
a much wider range of information from researchers and teachers than 
from practitioners. (Author/SL) 
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ot a grant Irom iirltish MUrury liosoarch and Dovulopmont Uopurtmont 
( Tt'^rim^r ly , Dtlioi) for SoluntllMfj ami Toohnlual Infovmat ion). The 
ijiMitral ti>am was based at thf Un Ivors ity of IJath, and assisted by 
ri»si»archt»rs at the polytcHihniu of North London School of Librurianship> 
and the Open University, The results of the rosoarch are reported in 
two series of papers, Tht'Sf reports can be obtained individually on 
lium From the Dritish Library Lending Division, Boston Spa; a limited 
number are available for purchase from the Secretary , Tho Library, 
Dath University, Claverton Down, lUTll nA2 7AY. 

The present report desGribt?s an experiment carried out in 1973, 
in which the parameters of an abstracting service were varied in 
experimental publications and user reaction assessed. The experiment 
was conceived by Mr M,Ba Line and Mr J,M, Br it tain; it was designed 
in detail by Dr \V,Y. Arms (Open University), who also arranged the 
detail of thi,* experimeiUal sorvici.* with Professor Kt Clayton of Geo 
Abstracts Limitc?d, Prori\ssor and Mrs Clayton organized the production 
of the service at the University of East Anglia, Miss B„ Skelton and 
Mr lirittuin rt.»cruiti?d tlie sampl«> of usi-rs, with assistance from Mrs 
B, White (Kdinburgh Unive^^s i ty ) , and th^ Dath team produce<l the follow- 
up (iut.»stit>nnaire and organi/.ful its dissemination and return. Miss 
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Tht-' rest ol iJie rt?port was written by Mrs C.R. Arms (Open University), 
whi) aLso carried out tht/ analyses. 
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AIISTHACT 



This report «(osoribod an exporimont baBOd on an Information sorvioo 
tor planners Aluoh was run in conjunction with Ooo Abstracts Limited. 
Forty-eight stylus oT abstmctlng Journal wore produced which» although 
bused on iho same source material, differed in depth of coverage (three 
luvels), frequency of publication (oMo-weekly, three-weekly and nine- 
weekly), content of entry (abstract, keywords or only citation) and whethor 
an Index was included. With a minor exception one style of Journal 
wus produced with each possible combination of these parameters. .Each 
style was sent for a trial period to four planners who had agreed to 
tiike part in the experiment. These users were asked to mark on sheets 
provided with ouch issue the items which chey noted and followed upi 
and to cnmpii ti» a questionnaire at the end of the experimental period. 
About TO^'r of users filled in tlie questionnaire^, and about 55% returned 
sheets which were at least partially completed. 

The results show a distinction between expressed preferences 
on the parameters varied and the styles which proved most useful in practice. 
In particular, although most users said they would prefer abstracts, 
the styles with only citations were most useful. The bulk of a 
publication appears to be an important factor in determining usability. 
The experiment also demonstrated a demand for a much wider range of 
information from researchers and teachers than from practitioners. 
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UO INTRODUCTION 

It L ObJi>clivi>s 

Tho uvuLuution ot xtUoriiiulion sorvlcos is an integral part of 
tho resi^arch lowarUs tho Design of Inl'ormation SystcMns in thu Social 
ScKMioos (l)KSISS). Thv Invc^sl igalion xnto Information Roquiromonts of 
the Souial SouMict's^ (INFROSS) showod that usi?rs aro usually unablo to 
stato what iin})rovoiuonts might in* \i\mIv In information .services in order 
to satisly thoir needs more fully, in the absence of an artual service 
to Nshioh th<*y can lel'or. If inrt)rmalion systems aro to be developed ' 
ami improviul, it is therefore necessary to create new services which can 
bt» tt^sted in practice. In tact this is how services have developed 
in tht» past; usually a oommeroial body or professional organization has 
established a new service, or changed an existing one, to meet a supposed 
market or neuil. The service has survived or not, according to the 
markt: t • 

Thert? w(?re two serious disadvantages in this procedure. First, 
the need is raieiy identified and stated clearly in advance; development 
therefore takes place large ly on intuition, although studies such as 
INFROSS can do something to elucitJate needs ami reduce the range of 
possii)i iitif.»s. Second, while any service has to pay its way unless it 
can .justily a subsidy, the market is a poor test of effectiveness for 
information services, because they are usually acquired by libraries and 
roc^'ivo no siibsequent practical evaluation; it is quite possible, and 
perhaps common, for an indexing or abstracting service to remain on 
library shelves totally unused. Moreover, if it is used, this may 
bo l)ecause peopl<? car» only use what there is available, however inadequate 
and capable of improvement it may be. One way in which progress might 

ma{Je ls to di>sign experimental services systematically to test 
spi'fMfic liypothoses, and evaluate them as carefully as possible; a large 
part of the DISISS project lias been devoted to this. Some evaluation 
has r\ <a L< mpl<»(i ot ongoing s(»rvi(;i\s; this is r(?ported elsewhere 
(Final Reports HI and H2), This rt^port deals with an experiment set 



This wa> carried out at the University of Dath between 1968 and 1970, 
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up to uxaminu the du<ii);n of aUsvractinr inUoxlng servicosi 

It is a ruusonublo assumption that publishod indexing and abstracting 
servici's wiil constitutu an important part of tlw total information system 
tor tho foroseoablo future, it is therefore important that the overall 
pattern of such services is carefully planned, disciplines being approp- 
r lately K^'^>upod und allocated between servicest Other parts of DISISS 
should providi> some uuidunce here (Final Reports A6 and B6)# It is 
equally ^ nportant that individual services should be carefully designed* 

An Indexing and abstracting service has several main parameters 
which can be varied* 

(1) Dreadlh and depth of coverage - (a) range of Journals, bookSi 
reports, etc*, from which material may be included; (b) degr3e 
of selection of items from these journals, etc* 

(2) Content of entry - entries may contain only the bare bibliographical 
details, or may include abstracts, which may themselves be 

of varying length. 

(3) Index - there may or may not be an index, and it may be more or 
less detailed, 

( 1) Frequency of issue 

(5) Up-to-dateness - which obviously depends partly on frequency of 
issue 

(6) Quality of production - which can vary from a stapled set of 
dupiioaied sheets to a professionally designed printed product. 

Obviously each of these has economic aspects; increased frequency, 
greater depth in indexing or fulness of abstracting, broader coverage, 
and superior quality of production all cost more. The important question 
is therefore, what combination, within a given cost limit, related to 
a reasonable salo price, is the most satisfactory for users. Would 
they, for example, sacrifice qual ty for frequency, or up-t«)-dateness 
for depth? An alternative question would be what is the optimum 
combination, and what would it cost • 



At prt>Honti abstracting ami inUi**xiug j)»rvicus exhibit groat 
varioty in thoHO paramo tors, but ust?rs solUom havo a chuico of alternative 
combinations within Ihoir own UiHcipiinii* U in highly irnprobublf* that 
all tho combinations that oxist aro in any sense optimal, and it is 
possible that none of them is. There is no means of knowing without 
experlmc»nt whether one combination Is preterablu to others* and if 
so which* 

A cMinbination ef pvirameters fimnU to suit one service will not 
necessarily Ik^ right tor one in a different discipline or one aimed 
at a diltt^rent tyue oi user, lUnvevor, an experiment with one service 
might produce some results so clear cut tliat they might bo expected to 
apply generally, and would also test the methodology of such an experiment • 
In the light of the results further experiments in other areas could 
be made. On the other hand, there might bo no clear preferences at all; 
even a negative finding would still be of interest and value since it 
would give producers a wider range within which to operate. 

For a valid experiment to be st.*l up, considerable resources 
were necessary. Firstly, the sul>ject matter on which to base the 
experimental service had to be selected and the relevant material 
made accessible. The experiment required editorial and other staff, 
production facilities, and a means of distribution to a fairly large 
number of users, for a period of up to six months, 

DISISS could clearly not design a new service from scratch. 
The co-operation of an existing service was therefore sought, whose 
producers would be willing to vary the parameters experimentally over 
a given period* 

1,2 Setting up the exptjrimental information service 

During 1972 contact was made with Goo Abstracts Ltd and agreement 
was rt-ached to ojM/rato win (^xp(;r imenta 1 .service using material from 
sections of Geo Abstruots relevant to planning. From 1966 to December 
1972 Geo Abstracts , formei ly Geographical Abstracts , was produced in 
four sections: A - Goomorphoiogy , B - FUogeography and Climatology, 



C ^ Kconuiilic Qeogruphyi and I) - Sooial Ueogruphy and Cartography t 

At the Uuglnnihg of 1973 a now soot ion was introduced i F - Regional 

and Community Plannlngi and the oxisting four sections were reorganised! 

so that the 1973 Geo Aba tracts was produced in six sections; A - 

Landforms and the Quaternary, U • Uiogeography and Climatolopy, C - 

Economic Geography. I) - Social GcHjgraphy and Cartography, E - Sediroentology , 

and P - Regional and Community Planning, With the introduction of a 

new section or abstracts, Geo Abstracts considered the production of an 

experimental service as a desirable test to evaluate not only the usefulness 

of the new section, but also the usefulness of Geo Abstracts generally 

as a secondary service. 

Each section of Geo Abstracts is issued six times a year. The 
service relies on a large number of voluntary abstractors from all 
over the world. There is one editor to each se<ltion and the overall 
editor of the service is Professor Kenneth Clayton, Professor of Geography 
at the University of East Anglia, from where tl>e service is ru . 

It was decided that the experimental service should be for 
environmental planners, and known as the Experimental Information 
Service for Planners. Environmental planners form a large and relatively 
uasily identifiable group of social scientists working in practice, 
rosoarch and teaching. The fact that the experiment was aimed at 
planners meant that the results would be of direct relevance to the research 
project, Organization of information for Planning (OIP), being carried 
out (also with the aid of a grant from OSTI) at the University of Edinburgh. 
The purpose of the OIP project is to ascertain the structure and composition 
of the information base of planning and to develop efficient methods of 
organising and disseminating it. 
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2«0 UESION AND CONDUCT OK TilK EXPKKnWNT 

2* I Tho tmratnolorH usuU in th<> t^Npor iim»nt 

Tlu' purposo or iUv c^xprrimcMU was to oUsorvu, mid uh far us 
pi)ssihlo moasuri.', usw prcliMHMiopH Tor llu* design of a secondary 
information sorv icu, Vsw prufi'ronous an* ono rc*a,Honul)io moasuro of 
usability and also of valut* of tho sorvico. Four paramoters were 
chosen fi)r Ihv i^xpor iinontt Thusi.* wuiu; 

Contont of entry 
Froquoncy 

Prosenco or absunce of an index. 



(I) 
12) 

CO 
(I) 



Other parameters which DISKSS cohsidercd but rojocted, were 
parameters relating to the format and presentation of the service. For 
instance, st/e of paper, colour i>l paper, type and si/.e of print, and 
page layout, may all affect the usability of a service. However, the 
resources necessary to test all thi\se parameters were not available. 
It was dc^cided to test the Tour parameters that ri^lated mainly to the 
bil)iiographical nature of the service rather than the physical format, 
A further parameter was also considered for inclusion in the experiment 
- currency of material in the service* * but was dropped because it 
proved too difficult to control within the existing ,>roduction routine 
of Geo Abstracts. Material is published in Geo Abstracts in the order 
in which it is received from the abs tractca^s, vSome times there is a delay 
of several months before material is received from an abstractor. Also 
Geo Abstracts uses material from other secondary services, particularly 
some publishe<i abroad, and there is sometimes a considerable delay between 
the first appearance* of the work and an abstract of it in Geo Abstracts . 
If currency was to be tested a very tight control system would have to 
be devised wher(.*by some materiiil was deliberately delayed and some 
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was abstrucWU as quickly as pubsibUs To havu sot up such a system would 
havo causcHl too much disrupt Ion in the regular production ol (jeo Abstracts » 
as wo 1 1 as complioatinK tho uxporimunt with tho attendant danger ol making 
the other results less valid or reliable, 

< I ) Coverage 

Material for C]eo Ahsiracts is selected by the editor, Professor 
Clayton, who scans approximately 2,000 Journals (so© Geo Abstracts List 
of Journals Ab^stracted ) and assigns relevant articles to the appropriate 
section (seo L.2). Articles from any Journal may appear in any section. 
The only criterion for inclusion is subject matter; no discrimination by 
quality is used. The list of Journals abstracted was extended for the 
purpos*^ ol the experimental service, but many of the additional journals 
will continue to be covered in the normal production of Geo Abstracts > 
Sources used to select the additional Journals were the Queen's University 
Science Library, Belfast; the Royal Town Planning Institute's Library; 
Sheffield University Planning and Landscape Library; and a list of planning 
journals^ (see Appendix C) produced by the Organization of Information 
for Planning (OIP) project at Edinburgh University. 

Books, reports and other published and semi-published material 
arc also abstracted. Books are selected mainly from publishers' lis ts , 
and other publicity material. British and US books are more thoroughly 
covered than others, because they are butter publicised. 

Foroign language material is covered, but expense and difficulty 
of translation restrict the amount of such material. For a short 
period Goo Abstracts undertook many translations of Soviet materials, 
but found tiioy were used by few people. In general abstracts were 
e^xcludod from the experiment if they were considered too eld. For the 
1U12 issues, this meant that all 1970 or earliej material was excluded; 
for the U)73 issues, 1971 and earlier material was excluded. 



The list was produced l>y taking all citations from articles relevant to 
British planning in 42 Journals published in 1970. 
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For Ihv oxperimontul Hurviou Uwvv Uinuront covorago puttorns 
woro uaed: 

P CovcruRo basod on the usual production of suction P of <jeo 

Abstracts - HoKional and Cummunity Plannina , Soctlun F covers 
tho followinp: topics: planninj? prohloms, planning tuchniquos 
and thoory. national i>lannint;» rojjional and economic planningi 
urban planning toohniquos and practice, rural planning, trans- 
pi>rtation planning, innovation, environmental planning and 
rosource allocation, social and community planning » and planning 
law and administration. This section of Geo Abstracts is aimed 
at two major groups ol users; practising planners in institutional 
or private practice, and research workers and others interested 
in ux^ban, regional, and environmental planning processes. The 
policy of the editor is "to complement, rather than duplicate, 
existing information and abstracting services by concentrating 
upon regional, urban, uiui environmental planning theory and practice 
rather than upon detailed and very local implementation or engineer- 
ing schemes. Such material is included where it is of general 
relevance. 

Q Coverage based on mainstream planning material. Core journals 

were defined as those in which more than two- thirds of articles 
are concerned with planning. Articles included in coverage P 
which came from core journals were included in coverage Q. Non- 
journal material from coverage P was included if it was regarded 
as mainstream and easily located. Most of this material was books 
from IJK or USA. Major HMSO publications were also included. 

R Coverage of urban planning only. Material from other sections, 

particularly C Economic Geography , and D - Social Geography 
and Cartography as well as section F, was included if it was 
rogardod as particularly relevant to urban planning. Examples 
of the additional topics covered are urban sociology, air 
pollution, and industrial location in urban areas. 
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The oxporimuntal servico uimuU to tuHt Iho usefulness of the 
throo covoragu puttorns, OrintnuUy it was hopoU that the oxpurimont 
woultl be ablu to tost covt»ruuo puttorns by using a selection of specific 
journal tttlos. This proved infoasiblo as Goo Abstracts select articles 
from any journal tor any section of the abstracts. It had been proposed 
that tho list of planning journals producud by citation studios (see 
Appendix C) conducted by th*) OrKani/.ut ion ol Information for Planning 
(OIP) Project at Kdinburgh University would be used in the experiment, 
Howovor, in onlor to ^aii some idea of the frequency of occurrence of 
individual journals in Geo Abstracts , a count was made of thr number of 
abstracts taken from tiach journal in sections C and D in 1970 and 1971 
and in the first two issues in section F in 1973* The results of this 
count art? shown in Appendix !)• The journals in Appendix I) that also 
occur in the ♦'requency list of cited journals are marked on that 

list (Appendix ' ) Only a small proportion of journals were in common; 
15 per cent of journals used in section D occurred in the OIP list, 19 
per cent in section C, and 9 per cent in section F. There is thus a 
large variation between journals considered by Geo Abstracts to be of 
relevance to planning and the journals identified by citation studies 
as being relevant to planning. In particular, material in sociological 
and statistical journals does not appear in Geo Abstracts . However, 
this variation should not havu affected too greatly this part of our 
vxporiment, which was concerned as much with variation of levels of coverage 
as with quality of coverage, 

(2) Content of entry 

Three forms of entry were used for the service. The first form 
was a full abstract. These abstracts were produced in the same manner 
as for tl)e rr?gular Geo Abstracts : by Geo Abstracts staff, from another 
secon(iary st»rvice, or by tho author of the article. The second form of 
entry was title plus keywords (see Index below). The keywords were selected 
bv a singl(? editor. This method is found by Geo Abstracts to be the 
cheapest and easiest way of a<*,hieving some consistency. The third 
form of entry consisted of titles alone with no keywords. 



(3) Pn^quoncy of issue 

The sorvloo was prmluiUKl in \voc»klyi throe-woekly , unci nino-weokXy 
rroquoncioH, AlloKOthor luiu* woukly Ihhuus wiau pro(iucoU» six thruu- 
weekly issues, unU three niiu^-weekly issues. It wus hopuU that those 
running; perxiuts would be adequate lor each ui^er to maKe valid Jud;;<Miiunts. 

(1) Imiox 

Hair the issues were produced with an author and subject index. 
The subject index was based on keywords from the artici3 title or body 
of the abstract and was produced by computer. 

2.2 Styles of publication 

The four parameters were combined to give forty-eight publication 
styles. All combinations were used except that coverage Q was not 
produced in weekly issues , because the number of items in each issue 
would have been very small. Each style was denoted by a four-character 
code made up as follows; 

Coverage: 

P - all section F 

Q - core material from section F 

R - urban planning material from sections C, D and F 

Content of entry: 

A - full abstract 

K - citation and keywords 

C - citation 

Frequency of issue: 

1 - weekly (nine issues) 

3 - three-weekly (six issues) 

9 - nine-weekly (three issues) 

Index: 

Y - index 

N - no index 
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Thus, PcaN indicates thu throo-weokly publication without index, 
with covi^rugo ol «outiou V oi Uoo Abstracts , and with ontrius consisting 
of citations only. 

2. 3 Organisation, production and distribution of the service 

Four copies of each of the forty-eight publications styles were 
distributed, each user receiving only one style. The list of 192 
planntTs was compiled by the DISISS team (see section 3.0), who were 
also responsible for answering queries from users, chasing up replies 
and analysing the evaluation data. The service was produced and 
distributed by Ooo Abstracts Ltd at Norwich, who employed a typist specif- 
ically for the experiment in addition to their normal staff. 

The dates of publication of each issue and the number of items 
in each issue are given in Table 1. The experiment ran for 27 weeks. 
The three-weekly service ran for the first 18 weeks, and was cumulated 
into the first two nine-weekly issues. The last nine-weekly issue was 
a cumulation of the weekly service which ran during the last nine 
weeks of the period. 

The typing load in the early weeks proved too great and the 
number of entries in the later throe-weekly issues was reduced. The 
number of entries in the last nine weeks was increased again by the 
inclusion of more ephemeral material to make the weekly issues a reasonable 
size. The author indexes were compiled by means of a simple card index. 
The subject indexes were compiled by computer except that those for the 
last two weekly issues were compiled by hand, owing to a strike by computer 
operators at the University of East Anglia. Some of the other clerical 
procedures were more time-consuming than had been estimated originally. 
For instance, collation, co(iing and dispatch of the twelve variations 
of the om.^-woekly issues took four people two hours each we«k. Each 
weekly issue took between two and three hours to print and was done on 
a specific day each wtiok. The three -weekly issues took longer but the 
load was spread over the three weeks. The print-room staff at the 
University of East Anglia photographed the plates, whilst the actual 
printing was done by Geo Abstracts Ltd. 
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TAUUi: 1 



NUMUKRS OP ITEMS IN ISSUKS OP THE 
EXPERIMENTAL, INFORMATION SERVICE FOR PLANNERS 







3 -weekly 












9-week ly 










u 

r 






u 
H 






p q 


n 

R 




I 


25 Oct 


178 


80 




126 












2 


15 Nov 


14 I 


52 




129 


1 


8 Dec 


451 17d 


368 




3 


d Dec 


120 


44 




113 












1 


27 noc 


111 


63 




99 












5 


19 Jan 


116 


58 




91 


2 


11 Feb 


347 172 


310 




6 


9 Fob 


120 


48 




120 
















1-woekly 






















P 




R 














1 


Id Feb 


60 




43 














2 


23 Feb 


51 




34 














3 


1 Mar 


42 




41 














•1 


8 Mar 


51 




57 




3 


14 Apr 


441 192 


376 


1 


5 


15 Mar 


54 




36 












! 

» 


d 


22 Mar 


53 




37 














7 


29 Mar 


38 




41 














8 


5 Apr 


41 




35 














9 


12 Apr 


51 




50 












I 

I 

i 



2.4 



Evaluation of the service 



Two methods of evaluation were used: one was a specific indication 
of Ltoms considorotl by the? user to bo of intorost and use to him, recorded 
on a toar-off sheet at the front of each issue; and the other was a general 
assessment, by a questionnaire sent out with the last issue of the 
service. Users were asked to return the questionnaires and the tear-off 
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sheets in a pre-paid envelope to the DISISS team. The questionnaires, 
an example of a tear-off sheet, and the accompanying letter, arc all 
shown in Appendix li . It was originally hoped that rating scales could 
be used in the quostionnairo, perhaps using tho scales being developed 
by Dr A.W. Clark of tho Tavistock Institute. However, Dr Clark ^s work 
on rating scales was not completed in time for use in tho questionnaire. 
The tear-off sheet was included so that users could record their 
actual uses, tear off the sheet for subsequent mailing and retain the 
service itself for future reference. 
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3,0 THE SAMPLE 

With forty-eight different styles of publication a sample size of 
a multiple of forty-eight was required. It was decided that 192 (4 X 
48) was as large a sample as could be recruited, although ideally the 
sample would have been larger. It was desirable that these should be 
from planners engaged in practice, teaching and research in a wide variety 
of environments. 

The Royal Town Planning Institute List of VIembers does not indicate 
whether planners work in practice, research or teaching. A list of 190 
planners was, however, available from the Organization of Information 
for Planning project, with a breakdown of the type of work carried out. 
A letter was sent to all 190, asking them to take part in the experiment 
and asking them also to send names and addresses of any of their colleagues 
who were interested in participating. The letter is reproduced in 
Appendix F. In all^ 105 of these expressed willingness and gave 60 
additional names. As 192 planners were needed to take part in the 
experiment, it was decided that further planners should be sampled 
from the Royal Town Planning Institue List of Members , even though this 
gave no indication of the type of work in which each planner was engaged. 
Of the 76 planners chosen a t^ran dom f JgJ^th^ list only 10 were willing 
to take part. A further 8 names of p«i?r ^Wia ( B ii » i »ik ng in planning research 
were obtained from 01 P because it became apparent that researchers were 
under-represented. Finally, the Municipal Year Book 1972 was used to 
obtain 23 more names selected at random. 
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Altogether, 2^7 planners wore sent letters in order to find 1U2 
wlu/ \.erf willing to tukt» part, V**ry lew of those who UiU not wish to 
tuko part In tho oxpt>riment sent lott(?rs to this effect; the majority 
did not roply. Seven planners took so long to reply that, although 
willinu to participate, they had to be turned down because by then the 
quota of luid bi en filled. Some people who took part in the experiment 
did so because their coileagu<?s had passed the letter on to them; usually 
only one or two individuals from a planning department or a university 
indlcatt»d their willingness to take part, but one department was 
repre?K»nted in the final sample by as many as 10 people. Table 2 summarizes 
how thi* final sample of li)2 planners was obtained, 

TAULE 2 
OBTAINING THE SAMPLE 



OIP's dip's Random sample 
mam extra from R.T.P.I. 

list list membership 

list 1971 



Random sample 
from Municipal 
Year Book 1972 



Total 



No, contacted 



No,, replies *yos 



No. replies *no 



190 



105 



8 



76 
10 
2 



23 
12 
2 



297 
133 
9 



No, turned down, 
replied too late 



No, of additional 
names ^ivon by 
colleagues 



60 



6 



66 



No. of letters 
returned because of 
wrong address 



8 



8 



Total numb«»r requiriMi for sampl** := 192 
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It was not possible to balance the numbers involved primarily 
in piuctico, research or teaching exactly between the throe service 
frequencies because the first tssues of the three-weekly services were 
ready for circulation before the sample had been fully recruited. The 
proportion of practitioners receiving the throe-weekly services is lower 
than for the other frequencies^ 

TABLE 3 

THE SAMPLE BY PRIMARY NATURE OF WORK 



Nature of work l-weekly 3 -weekly 9 -weekly Total 

service service service 



Practice 


24 


50.0% 


29 


40. 3% 


36 


50.0% 


89 


46.4% 


Research 


9 


18.8% 


19 


26 . 4% 


9 


12.5% 


• 37 


IJ.3% 


Teaching 


11 


22.9% 


20 


27.8% 


21 


29.2% 


52 


27.1% 


Not known 
beforehand 


4 


8.3% 


4 


5.6% 


6 


8.3% 


14 


7.3% 


TOTAL 


48 




72 




72 




192 





The imbalance between practising planners and academics also shows 
up when the sample is grouped by the type of employing body (Table 4 on p.l5)* 

1.0 STATISTICAL ANALYSIS I 

4. 1 Basic tabulations of questionnaire responses 

A questionnaire (see Appendix E) was sent to each participant 
aft.?r he had received all the issues of the experimental service. Of 
vho 192 participants, 129 returned questionnaires, giving a response rate 
of 67.87o, As mentioned in section 2.1, four service parameters were 
varied, and t^ach participant was allocated a code to describe the service 
received. The lour parameters are; 

(i) Coverage (P, planning; Q; core journals only; R, urban planning) 

ERLC 
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TABLE 4 



THK SAMPLE BY EMPLOYING BODY 



Employing body 



Central Govornment 
(DOE) 

Regional author- 
ities 



I -weekly 
service 
N % 



2.1 



County authorities 6 12.5 

G.L.C 1 2.1 

Development author- 
ities (includes new 
towns) 

Borough authorities 19 39.6 



3-weokly 
service 
N % 



2 
14 
6 

1 
3 



2.8 

2.8 
19.4 
8.3 

1.4 
4.2 



9-week ly 
service 
N % 



1 1.4 

6 8.3 
14 19.4 



6 8.3 
9 12.5 



Total 

N % 

3 L.6 

9 4.7 

34 17.7 

7 3.6 

7 3.6 

31 16.1 



Universities 

Polytechnics 

Colleges of Art 

Research Institut- 
ions 



14.6 



4.2 



4.2 



4.2 



21 29.2 



8.3 



2.8 



11 15.3 



14 19.4 

9 12.5 

1 1.4 

4 5.6 



42 21.9 

17 8.9 

5 2.6 

17 8.9 



Private practice 
Other 

Not known before- 
hand 

TOTAL 



8 16.7 



4.2 



1.4 



3 4.2 



5 6.9 



48 



72 



72 



3 1.6 



3 1.6 



14 . 7.3 



192 



Subtotals 
Government 

Academic bodies 



27 56.3% 28 38.9% 



13 



27.1% 40 55. 6^ 



36 50.0% 



28 38.9% 



91 47. 



81 42.2% 
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(ii) Length of item (A, abstracts; K> title and keywords; C, title 
only) 

(iii) Frequency of publication (1-, 3-, 9-woekly) 

(iv) Index (Y, with author and subject index; N, with no index). 

All code combinations were used except l-weekly services with 
coverage Q which would have had very few items in each issue. Each service 
typo was sent to four participants and the numbers of responses are given 
in Table 5. Three people returned some of the tear-off sheets which 
accompanied the individual issues but did not complete the questionnaire. 
In Table 6 the response rates for particular parameter values are given. 

TABLE 5 

NUMBERS OF RESPONSES BY SERVICE TYPE 



PAIY 3 
PAIN 3 
PA3Y 4 
PA3N 4 
PA9Y 2 
PA9N 3 
PKIY 3 
PKIN 2 
PK3Y 2 
PK3N 2 
PK9Y 2 
RK9N 2 
PCiY 3 
PCl.M I 
PC3Y 4 
PC3N 3 
PC9Y 3 
PC9N 1 



QA3Y 2 
QA3N 2 
QA9Y 3 
QA9N 2 



QK3Y 4 
QK3N 3 
QK9Y 2 
QK9N 2 



QC3Y 2 
QC3N 3 
QC9Y 4 
QC9N 3 



RAIY 3 
RAIN 3 
RA3Y 3 
RA3N 3 
iiA9Y 3 
RA9N 4 
RKIY 3 
RKIN 3 
RK3Y 3 
RK3N 2 
RK9Y I 
RK9N 4 
RCIY 4 
RCIN 3 
RC3Y O 
RC3N 3 
RC9Y 1 
RC9N 1 
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TABLE 6 

I RESPONSE RATES FOR INDIVIDUAL PARAMETERS 

> 

{ Overall response rate 67 .8% 

Parameter Sent Returned Response rate 

fP 72 50 69.4% 

Iq 48 32 66.7% 

|h 72 47 65.2% 

A 64 47 73.5% 

•K 64 40 62.5% 

C 64 42 65.7% 



. i 48 37 77.0% 

3 72 49 • 68.0% 

.9 72 43 59.7% 



Y 96 64 66.7% 

N 96 65 67.7% 



In the remainder of this section the questions will be stated 
as in the questionnaire and brief results given for each question, 
injlependent of responses to any other question. Unless otherwise 
stjited, percentages are of the number of respondents (129), 

Nature of work : (mark as many boxes as applicable) 

practice 75 58,1% 

teaching 50 38,8% 

research 76 58,9% 
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Moro specific combinations of those three aspects of planning (Pi T, 
R) are: 

Nature of work No, of respondents 

p 43 33.3% 



TR 



lU) 23.2% 



R 19 14.7% 

PR 17 13.3% 

PTR 10 7.7% 

T 5 3.9% 

PT 5 3. 9% 

Do you subsc ribe to, or use, Geo Abstracts? 

yes 31 24.1% 

no 98 76.0% 

Do you use regularly any other information service? 

yes 64 49.5% 

no 65 50.3% 

If 'yes' please name ; 

Apart from respondents' own library services, the information 
services that were used by more than one respondent were: 

Department of Environment Library Bulletin 27 users 

Planning and Transportation Abstracts (GLC) 14 users 

Town and Country Planning Association Bulletin 13 users 
Quarterly Bulletin of GLC Intelligence Unit 3 users 

Tho noE Li^>rary Bulletin was therefore used by 437o of the respondents 
who said they regularly used an information service other than Goo Abstracts . 

Combining the responses to these two questions, 58,97o of the 
sample normally use an information service. 
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How did you uso the Experimental Service you received? 

read there ughly 'M 2^.l7o 

scanned through 83 64,3% 

Klanced at 9 7.0% 

did not use 1 0.8% 

no answer 5 3 9 9% 



Do you think you recoived issues . . . 

Over a 1 1 1 -week ly 



too i'requently? 
at about the 
right frequency? 
not frequently 
enough? 
no answer? 



30 23.2% 18 48.6% 



83 64.2% 18 48.6% 



13 10.0% 
3 2*3% 



1 2.7% 



3-weekly 9-weekly 
9 18.2% 3 7.0% 

35 71.4% 30 69.8% 

4 8.3% 8 18.6% 
1 2.1% 2 4.7% 



(percentages are of column totals) 



If *too frequently' or 'not frequently enough 'i please suggest reasons 
fpr your reply : 

From those who thought that issues were received too frequently, 
the most usual reasons were: 

(i) Issues piled up before there was time to read them, or to 
follow up items 

(ii) It is time-consuming and inefficient to scan many small 
issues when the chance of finding something of interest 
in any issue is low 

Other comments were: 
(iii) Small issues are easily mislaid 
(iv) For building up a long-term bibliography, consolidated lists 
arc of more use than many of small issues 

Reason (i) was given for both 1-weekly and 3 -weekly services. 
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The two rousons given for the issues not being frequent enough 

were: 

(I) The volume of material was too large to wade through in one 
session and was therefore inhibiting 
(ii) Some of the material was out of date and had already been 
obtained through other channels 



Reason (ii) was given for both 3 weekly and 9-weekly services. 



Ho w frequently would you Ideally wish to receive issues? 

weekly 14 10.8% 

fortnightly 11 8.5% 

monthly 60 46.5% 

every 2 months 27 20.9% 

quarterly 13 10.1% 

no answer 4 3.1% 



Entry format 

Questions about the entry format differed according to the entry 
format of the service received by the participant. The first question 
was of the form; 



Did you find the entry format adequate foi assessing the relevance 
of material in the service? 

Overall A K C 

not adequate 25 19.3% 3 6.4% 11 26.8% 11 26.2% 

sometimes adequate 68 52.7% 20 42,6% 20 48.7% 29 69.0% 

completely adequate 35 27.1% y4 51.1% 9 21.9% 2 4.8% 

no answer 1 0.8% 1 2. 4% 

(percentages are of column totals) 



Abstracts appear to be inadequate less often and more often 
completely adequate then either 'title' or 'title with keywords'. The 
inclusion of keywords with titles appears to increase the proportion 
of people completely satisfied but still leave about the same proportion 
dissatisfied. 



- 21 - 



Participants whose service included abstracts (A) were asked 
if they would ha\/o been satisfied with; 

yes no no answer 

titles and keywords? 14 32 I 

titles alone? 3 43 I 



Participants whose service provided titles and keywords (K) 
wore asked if they would have; 



yes 
24 



preferred abstracts? 
been satisfied with 
titles alone 3 



no 



16 



37 



no answer 



Participants whose service provided titles only were asked if 
they would have preferred: 



abstracts? 

titles aad keywords? 



yes 

30 
31 



no 

10 
10 



no answer 

2 
1 



Of these^ 23 would appreciate either expansion of the entry format 
and 3 would not want either. The remainder are equally divided between 
preferring abstracts but not keywords , or keywords but not abstracts. 



Inde x 

Participants whose service included an author index and a subject 
index were asked if they used the indexes i and, if not, whether this was 
because they did not need to or because the index was not easy to use. 



22 



Author index 



Subject index 



used 

not used 
no answer 



14 21. y% 



48 75.0% 
2 3.1% 



34 53.1% 
27 42.2% 
3 4.7% 



(percentages of 
respondents 
with indexes) 



did not need to 
not easy to use 
no answer 



37 77.1% 
2 4.2% 
9 18.8% 



16 59.2% (percentages of 

7 25.9% respondents not 

4 14.8% using the specified 

index) 



They were also asked if they would have preferred any other type 
of index. 



yes 
no 

no answer 



20 
34 
10 



Among the types of index suggested the most Irequent (8 mentions) 
was a more reliable subject index^. Suggestions ranged from a standard 
library classification to division into broad topics such as 'rural 
planning* and 'urban planning'. Several people suggested that grouping 
items under subject headings would be very convenient. A cumulative 
subject index once or twice a year was also requested. Other suggestions, 
in order of frequency, were: 

geographical index (4) 
keywoid index (3) 

grouping by journal or issuing body (2) 
combined subject/author index (1) 

grouping by type of material (e.g. book, article) (1) 
author and title index pointing to abstracts (1) 



The subject index provided was generated automatically using the title 
and keywords derived from the body of the article. There was no 
thesaurus of keywords for use in indexing; instead, all keywords were 
chosen by the editor. 
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The participantswhoso servicu did not Include an index were 
asked if they would have found an index useful; 



yes 
no 

no answer 



52 80,0% 
10 15.4% 
3 4«6% 



(peroentages are of the 
number of respondents whose 
service did not include an index) 



If yes, which of the following indexes would you have used? 



author 
subject 
geographical 
keyword 



U 17.3% 

15 86 .6% 

11 21.2% 

23 44.2% 



( percentages are of 
those respondents 
requiring an 
index) 



Did you find the number of entries in each issue^ . • 



too few? 
about right? 
too many? 
no answer? 



24 
66 
31 
8 



18.6% 
51.2% 
24.1% 
6.2% 



The number of entries in each issue is affected by two of the 
service parameters, frequency and coverage. The services for each 
combination of these parameters had average numbers of entries per 
issue as given below, 

frequency 

1- weekly 3-week ly 9-week ly 

P 49 136 413 

coverage Q - .58 180 

R 42 113 351 



It is of interest to breakdown the overall figures in three 
ways: (a) by c^^verage; (b) by frequency; and (c) by number of entries 
per issue. 
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(a) by coverage 







number of entries 








too few 


about right 


too 


many 


p 


8 17.4% 


26 56.5% 


12 


26. 1% 


Q 


8 25.8% 


17 54.8% 


6 


19.6% 


R 


8 18.2% 


23 52.2% 


13 


29.6% 




(percentages 


are of row totals) 






(b) by frequency 














number of entries 








too few 


about right. 


too 


many 


1 -weekly 


13 35.2% 


22 59.4% 


2 


5.4% 


3 -weekly 


8 18.6% 


26 60. 5% 


9 


20. 9% 


9 -weekly 


3 7.3% 


18 44.0% 


20 


48.7% 




(percentages 


are of row totals) 







(c) by number of entries per issue 

For this purpose it seems reasonable, from the earlier table of 
number of entries per issue, to divide the parameter combinations into 
three groups • 

number of entries 









too 


few 


about 


right 


too 


many 


PI, 


Q3, 


Rl 


19 


36.8% 


30 


56.6% 


4 


7.5% 


P3. 


Q9, 


R3 


4 


9.5% 


27 


64.4% 


11 


26 . 2% 


P9. 


R9 




1 


3.8% 


9 


34.8% 


16 


61.5% 



(percentages are of row totals) 
In the first table the Q row is not completely comparable with the 
other rows because the Ql service was omitted. However the similarity 
of the P and R rows implies that the reaction to the number of entries 
is independent of the difference in the two types of coverage. In 
tables (b) and (c) a diagonal pattern is clearly observable, with a 
considerable proportion finding the number of entries in the small 
frequent issues too small, and a very high proportion finding the 
number in the largest issues too great. As might be expected, this pattern 
is more pronounced in the breakdown by entries per issue than in that 
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by frequency. As a general concluslont it appears that most planners 
find 400 entries too many to road throuf{h at one session and a good 
proportion find 50 too few to justify the effort. A satisfactory number 
seems to bo between 100 and 200. 

Covorago 

Would you have liked the service to cover . . . 
(Mark as many boxes as appropriate) 

by coverage type 





overall 


P 


Q 


R 


mure journals? 


59 


45.8% 


20 . 


IS 


19 


more books? 


48 


38.2% 


19 


10 


19 


more reports etc.? 


79 


61.3% 


27 


18 


34 


lower journals? 


12 


9.3% 


3 


3 


6 


fewer booLiS? 


9 


7.0% 


3 


2 


4 


fewer reports etc? 


7 


5.4% 


4 


1 


2 


No. of respondents 


with 


coverage type 


50 


32 


47 



Taking percentages of the number of respondents, the breakdown 



typo 


of the demands 


for greater 


coverage are; 








P 


Q 


R 


more 


journals? 


50.0% 


47.0% 


40.4% 


more 


books? 


38.0% 


31.1% 


40.4% 


more 


reports etc'* 


54.0% 


56 . 2% 


72.3% 



The journal sources used for coverage Q were a subset of those 
used for coverage P, including only journals with over two-thirds of 
their articles relevant to planning. The fringe journals omitted for 
Q do not appear to have been very important. For coverage R, a wider range 
of journals was used» with articles being selected only if they were rele- 
vant to urban planning. More of the respondents who received this type 
of coverage appear to have found the journal range too great and 
fewer of them required more journals to be covered. 
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Did you find the amount of foreign language material covered ^ . . 

too little? 14 10^9% 

about right? 52 40^6% 

too much? 46 35 • 9% 

no answer 16 12,5% 

Plea? e give any other comments you have about the choice of items covered ; 



There were several comments which were made a number of times. 
They are listed with, where appropriate, numbers of occurrences broken 
down by coverage type^ 

(i) Much material too difficult to obtain (P, 2; Ri 3) 
(ii) Unsatisfactory mixture of research and journalistic weekly 
magazines (P|2; Q, 2; R, 1) 
(iii) More material always welcome (5) 
(iv) Indication of attempted coverage requested (4) 
(v) Reports and semi-published material most useful as this 
information is not available elsewhere (7) 
(vi) Little of practical value to planning (R, 2) 
(vii) Not comprehensive enough (P, 3; Q, 5; R, 3) 
(viii) Too wide (P, 2; R, I) 

(ix) Insufficient foreign material (American, 1; European, 2) 
(x) Editorial Judgement of value wanted (2) 

Particular requests for subjects not adequately covered included; 

(i) Rural planning (Q, 1; R, 2) 

(ii) Transportation planning (P, 1) 

(iii) Demography (R,l) 

(iv) Design (Q, 1) 

(v) Jo urnal of Planning and Environment Law , Architects Journal 

(P, 1) 



From the figures and comments on coverage a few general conclusions 
can be drawn. At least half the respondents would like greater coverage, 
especially of reports and semi-published material, for which the information 
services currently available appear to be inadequate. Foreign material 



- 27 



is not useU by many planners, although some individuals regard it as 
important. Some ol tht.» recipients oi covorago R dislikod the bias 
towards urban planning, but these wore people specifically interested in 
rural planning who would clearly not subscribe to a service for urban 
planners. However, at loast one urban planner requested additional peri- 
pheral material in the field of population studies and other wider topics. 

Taken as a whole do you rate the Experimental Service which you have 
recoivod as , , , 

of no use to you? 4 3,1% 

of little use? 40 31,0% 

moderately useful? 66 51,2% 

very useful? 17 13,2% 

no answer 2 1,5% 



How do you think that the Experimental Service could be improved to 
make it of more use to you? 

The most frequent suggestions are given below with comments. 
Unless otherwise stated the distribution of the suggestions over the service 
parameters was fairly even, 

(i) Group entries under broad subject headings (24) 
(Mostly from 3- and 9-weekly services) 
(ii) Increase coverage (14) (None from 9-weekly service) 
(iii) Print on index cards or in other form suitable for incorp- 
orating into a personal filing system (6) (None from 
coverage Q, Mostly from 3- and 9-weekly services) 
(iv) Improve layout (5) (Title to be prominent rather than 
author; 

(v) Increase coverage of reports and semi-published materials 
(5) 

(vi) Provide facility for obtaining photo-copies (3) 
(vii) Emphasize practical rather than academic planning (3) 

In addition to those, there were comments on indexing reinforcing 
people's response to the questions on that topic and a few lequests for 
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more sophisticated services such as a computer system for generating 
bibliographies! or a system which sorted by subject area and sent subscribers 
information only on their chosen areas. Another request which appeared 
in several guises was that the selection policy and range of source material 
considered should be explicitly stated, A fixed » regularly updated keyword 
thesaurus was also suggested. 

Would you subscribe to the Experimental Service if it were to become fully 
opera tiona I? 

yes 69 53,5% 

no 51 39,5% 

no answer 9 7,0% 

This question is somewhat ambiguous in that several people commented 
that their organization would subscribe although they would not want 
to personally. Since it is not clear which way those who did not comment 
interpreted the question, these figures have little reliability. However, 
they are likely to urder- rather than over- estimate the proportion who 
would subscribe either personally or through their organization. 

If you were to subscribe > how much per annum would you be prepared to 
pay for a personal subscription? 



up to £.'i.oO 


22 


17,1% 


£2.50 - £5.CX) 


37 


28,6% 


£5.00 - £10,00 


14 


10,9% 


£10.00 - £15.00 


2 


1.5% 


£J5.00 - £20,00 


2 


1 . 5V; 


moro than £20,00 


1 


0.8% 


no answer 


51 


39.5% 



Again many people answered this question for a 'lepartment sub- 
scription rather than a personal one, and the figures have little value. 
It is however clear that a service aimed at individuals rather than 
libraries should not be pri::ed about five pouncis ( at 197o values). 
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Would you prof or 

a publication issued oncu u fortnight, with rudimentary 

indexes and no abstracts, 24 18.8% 

or 

a publication issued every two months with full abstracts 

and indexes? 97 75 #8% 

no answer 7 5 •5% 

Would you prefer 

a publication issued once a fortnight but with very 

limited coverage, 14 10.9% 

or 

a publication issued every two months but with a wide 

coverage? 96 75*0% 

no answer 18 14^1% 
Would you prefer 

a publication with wide coverage but no abstracts, 54 42*2% 
or 

a publication with limited coverage but good abstracts? 57 44. 5% 

no answer 17 13.3% 

For a further discussion of this question see section 4. 5. 

If the basic publication was issued every two months, with reasonable 
coverage and good abstracts and indexes, would you be prepared to pay 
extra for an additional publication, issued fortnightly, consisting of 
titles only, with keyvord indexes? 

yes 26 20.3% 

no 8J> 69.5% 

no answer 13 10.2% 
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4,2 Didtribution of service pararooters by nature of work of questionnaire 
respondents 

Ideally the distribution of types of service between users involved 
in research, practice and teaching should have been balanced* However 
because of the large number of parameter combinations and the fact that 
the full sample of users had not been recruited before the first issues 
were distributed, this was not wholly possible (see section 3,0), In 
any case this would have been no guarantee that the distribution by nature 
or work of the respondents to the questionnaire would be balanced. 

The breakdown of service parameters by nature of work (P, practice; 
T, teaching: R, research) of respondents is as follows: 

TABLE 7 

SERVICE PARAMETERS BY NATURE OF WORK 
Nature Covera^o Entry format Frequency Index Total 



of work 


P 


Q 


R 


A 


K 


C 


1 


3 


9 


No 


Yes 




P 


17 


13 


13 


13 


12 


18 


12 


14 


17 


23 


20 


43 


TR 


12 


10 


8 


16 


9 


5 


4 


18 


8 


15 


15 


30 


R 


4 


4 


11 


7 


7 


5 


4 


11 


4 


9 


10 


19 


PR 


9 


1 


7 


5 


5 


7 


8 


3 


6 


8 


9 


17 


PTR 


4 


2 


4 


5 


2 


3 


4 


1 


5 


5 


5 


10 


T 


3 




2 




4 


1 


4 




1 


3 


2 


5 


PT 


1 


2 


2 


1 


1 


3 


1 


2 


2 


2 


3 


5 


TOTAL 


50 


32 


47 


47 


40 




37 


49 


43 


65 


64 


129 


P+ 


31 


18 


26 


24 


20 


31 


25 


20 


30 


38 


37 


75 


T + 


20 


'.4 


16 


22 


16 


12 


13 


21 


16 


25 


25 


50 


R + 


29 


17 


30 


33 


23 


20 


20 


33 


23 


37 


39 


76 
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The lower table is thc> breakdown over all Individuals involved 
in practice (P+), all those involved in teaching <T+) and all those involved 
in research (R+), The balance for services with and without index is 
very good for specific combinations as well as for the accumulated 
split between practice, teaching and research. The balance for the different 
levels of coverage is I'aii ly good, at least for the accumulated splits 
For the different frequencies and entry formats the balance is not 
so good. More researchers and fewer practitioners received the 3-weekly 
service than the other frequencies. More researchers received services 
with abstracts, and more practitioners received services with titles 
only than other entry formats. However, the imbalance as tested by the 
usual contingency table test on the lower tables is not significant at 
the lO^^o level, 

4,3 User satisfaction broken down by other factors 

Responses to Question 13a asking users to rate the service were: 

(1) of no use 4 3,2% 

(2) of little use 40 31.5% 

(3) moderately useful 66 52.0% 

(4) very useful 17 13.4% 

The response to this question will be called user satisfaction. 
Two respondents did not answer this question and will be ignored in this 
section. They both gave overwork and lack of time as their reason for 
not participating fully in the experiment. 
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TABLE 8 

USER SATISFACTION I3V SKRVICE PARAMETERS SINGLY 

satisfaction 







I 


2 


3 


4 


1 


2 


3 


4 




p 


1 


t A 


27 


o 




29. 1% 


Oo . J/0 




coverage 


Q 


0 


9 


16 


7 




28. 1% 


50,0% 


. 2 1 • 9% 




R 


3 


17 


23 


4 


6.4% 


36.2% 


48.9% 


8.5% 




A 


2 


14 


25 


5 


4.3% 


30.3% 


54.4% 


10.8% 


entry 


K 


1 


14 


20 


4 


2.6% 


35.9% 


51.2% 


10.3% 


format 


C 


1 


12 


21 


8 


2.4% 


28.6% 


50.0% 


19.0% 




1 


1 


12 


19 


5 


2.7% 


32.4% 


51.3% 


13.5% 


frequency 


3 


2 


15 


24 


7 


4.2% 


31.2% 


50.0% 


14.6% 




9 


1 


13 


23 


5 


2.4% 


30.9% 


54.8% 


11.8% 




N 


1 


20 


32 


12 


1.5% 


30.8% 


49.2% 


18.5% 


index 


Y 


3 


2n 


34 


5 


4.8% 


32.8% 


54.9% 


8.1% 



It is clear that the distribution of satislaction is independent 
of the service frequency. Tests for differences in the row means of the 
other tables (using 1-way analysis of variance on the 3 row tables) 
revealed that the row means for the different coverages and those for 
the service with and without index are significantly different at the 10% 
level but not at 5%. The row means of the entry format table are not 
signficantly different. Treating the tables as contingency tables 
(omitting the first column) no significant differences were found between 
the rows. 

Points of interest in the tables, bearing in mind that the differences 
are not very signficant, are: 

(i) Coverage Q (core material) was more often very useful and 
coverage R (urban planning) generally less useful than 
coverage ?• However, not all recipients of coverage R were 
specifically urban planners, so the latter might be expected. 

(ii) The services without an index were more often very useful 

than those with one, as were the services with titles only* 
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Since those indications ure slightly surprising, it Is worth 
looking at tho broukUown oi' usor sutisi'actlon in more dotuil. 



TABLE U 

USKR SATISFACTION UY SERVICK PARAMETER COMBINATIONS 



PAIY 


3, 


3, 3 










RAIY 


2, 


2, 


1 




PAIN 


2, 


3, 1 










RAIN 


^* 


4, 


2 




PA3Y 


4, 


3, 3, 3 


QA3Y 


2, 


3 




RA3Y 


2, 


3, 


2 




PAIJN 


2. 


3, 2, -1 


QA3N 


2, 


3 




RA3N 


3, 


I, 


3 




PAi)Y 


2. 


9* 


QA9Y 


3, 


3, 


3 


RA9Y 


3, 


2, 


3 




PAWN 


3, 


3, 2 


QA9N 


3, 


3 




RA9N 


3, 


4, 


3, 


3 


PKIY 


3, 












RKIV 


3, 


3, 


3 




PKIN 


•i, 


3 










RKIN 


3, 


4, 


3 




PK3Y 


3, 


9* 


QK3Y 


2, 


2, 


2, 4 


RK3Y 


1, 


3, 


2 




PK3N 


3. 


3 


QK3N 


3, 


3 


3 


PK3N 


4, 


3 






PKUY 


3. 


2 


QK9Y 


3, 


2 




RK9Y 


3 








PKUN 


2. 


3 


QK9N 


2. 


3 




RK9N 


2, 


2, 


2, 


2 


PCIY 


4, 


3, 3 










RCIY 


2, 


2, 


3, 


3 


PCIN 


3, 


3, 2, 2 










RCIN 


3, 


3, 


2 




PC3Y 


3, 


3, 3, 3 


QC3Y 


2. 


3 




RC3Y 










PC3N 


3, 


2, 4 


QC3N 


2, 


4, 


4 


RC3N 


2, 


3, 


2 




PC9Y 


1, 


2. 2 


QC9Y 


4, 


3, 


3, 4 


RC9Y 


3 








PC UN 


3 




QC9N 


4, 


4, 


3 


RC9N 


3 










♦ 9 


indicates 


no reply. 



















One hypothesis that is suggested by this table is that the sheer 
volume of the material in the P9 and R9 services is inhibiting in a service 
intended for personal use rather than for reference in a library. 
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TABLE 10 

USER SATISFACTION BY NATURE OF WORK 



Nature 
of work 


1 


2 


User 

3 


satisfaction 
4 1 


2 


3 


4 


P 


(43) 


2 


17 


22 


2 4.7% 


39.5% 


51.2% 


4.7% 


TR 


(2i>) 


2 


5 


13 


9 6.9% 


17.2% 


44.9% 


31.0% 


R 


(19) 




8 


10 


1 


42. 1% 


52.6% 


5.3% 


PR 


(16) 




tf 


8 


2 


37.5% 


50.0% 


12.5% 


PTR 


(10) 




2 


6 


2 


20.0% 


60.0% 


20.0% 


T 


( 5) 




1 


3 


1 


20.0% 


60.0% 


20.0% 


PT 


( 5) 




I 


4 




20.0% 


80.0% 




overal 1 


(127) 


4 


40 


66 


17 3.2% 


31.5% 


52.0% 


13. i% 



P+ 


(74) 


2 


28 


40 


6 


2.7% 


35. 1% 


54.1% 


8.1% 


T+ 


(49) 


2 


9 


26 


12 


4.1% 


18.4% 


53.0% 


24.5% 


R+ 


(74) 


2 


21 


37 


14 


2.7% 


28.4% 


50.0% 


18.9% 



An analysis of variance on this lower table is not strictly applicable 
since the three rows are not independent • But the fact that some respondents 
appear in more than one row would tend to make the row means closer than 
otherwise. The analysis of variance calculations suggests that these 
row means are significantly different at the 10% level, but not at the 5% 
level, considering only the two largest categories, the d 'erence between 
the P (practice only) and TR (teaching and research rows in the upper table 
is significant at the 5% level. 
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It is obvious from the table that the group of people doing teaching 
and research was on the whole more satisfied with the service than those 
only involved in practice. Those involved only in research seemed less 
satisfied than those also teaching, perhaps because they keep up with 
primary material and find the time-lag too great, or because they have 
better library facilities. Many of the teachers were from polytechnics 
or colleges of art, which often have small libraries. 
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Considering only the two largest groups, (P and TR) the break- 
downs by service parameters are as follows: 

TABLE 11 

USER SATISFACTION BY SERVICE PARAMETERS FOR 
THOSE INVOLVED ONLY IN PRACTICE 



Service 
code 

Overall (43) 



User satisfaction 
12 3 4 



17 



22 



4.7% 39.5% 51.2% 



4.7% 



Q 

R— 



(17) 
(13) 
(13) 



7 
4 
6 



U 
7 
6 



5.9% 41.2% 52.9% 

30.8% 53.8% 15.4% 
7.7% 46.2% 46.2% 



-A— 
-K— 
-C— 



(13) 
(12) 
(18) 



1 
1 



5 
5 
7 



8 

6 
8 



8.3% 
5.6% 



38.5% 
41.7% 
38.9% 



61.5% 
50.0% 
44.4% 



11.1% 



-3- 

-9 

-N 
-Y 



(12) 
(14) 
(17) 

(23) 
(20) 



5 
6 
6 

10 
7 



7 

7 
8 

11 
11 



7.1% 
5.9% 



10.0% 



41.7% 
42.9% 
35.3% 

43.5% 
35.0% 



58.3% 
50.0% 
47.1% 

47.8% 
55.0% 



11.8% 
8.7% 
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TABLE 12 



USER SATISFACTION BY SERVICE PARAMETERS FOR 
THOSE DOING RESEARCH AND TEACHING 



Service User satisfaction 

code 1234 1 2 3 4 

Overall (29) 2 5 13 9 6.9% 17.2% 44.8% 31. 0% 



P (11) 1 7 3 9.1% 63.6% 27.2% 

Q— (10) 2 4 4 20.0% 40,0% 40,0% 

R— • ( 8) 2 2 2 2 25.0% 25.0% 25.0% 25.0% 



-A— (15) 2 3 7 3 13.3% 20.0% 46,7% 20.0% 

■K— (9) 15 3 11.1% 55.6% 33.3% 

•C— ( 5) 1 1 3 20.0% 20,0% 60.0% 



— 1- < 4) 1 1 1 1 25.0% 25.0% 25.0% 25.0% 

--3- (18) 1 3 8 6 5.6% 16.7% 44.4% 33.3% 

—9- (7) 14 2 14.3% 57.2% 28.6% 

N (15) 1 1 7 6 6.7% 6.7% 46,7% 40.0% 

— -Y (14) 1 4 6 3 7.1% 28.5% 42,8% 21.4% 

From these two tables it would appear that the fact that 
practitioners found the service less useful than those doing teaching 
and research is reasonably independent of all the service parameters 
that were varied, or at least of the particular variations used. One 
possible reason for this is that articles and books on planning tend 
to be rather academic, and practising planners require material with 
more down-to-earth ideas and experience. Perhaps a much more selective 
service with one or two issues a year and confined to material on actual 
projects or experiments would suit them better. The two practitioners 
who regarded the service as very useful both received the same service 
(QC9N) with the core material in the most compact form. 
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TABLE 13 

USER SATISFACTION BY USE OF INFORMATION SERVICES 

satisfaction 

1234 1 2 3 4 

Use Geo ! 

Abstracts 3 18 6 17 .3% 62.0% 20.7% 

Do not use 

Geo Abstracts 4 35 48 11 4.1% 35.7% 49.0% 11.2% 

Use other infor- 
mation service 2 24 28 8 3.2% 38.7% 45.2% 12.9% 

Do not use 

other service 2 16 38 9 3.1% 24.6% 58.5% 13.8% 

Overall 4 40 66 17 3.2% 31.5% 52.0% 13.4% 

From these figures it appears that participants who already used 
Geo Abstracts found the service more useful than participants who did 
not. These two responses can be combined as follows: 

Satisfaction 

1234 1 2 3 4 

Use any infor- 
mation service 2 25 36 11 2.7% 33.9% 48.7% 14.9% 

Do not use any 

service 2 15 30 6 3.8% 28.3% 56.5% 11.3% 

This indicates that there is no straightforward •novelty* effect 
and people who previously used no information service were not generally 
more, or less, satisfied than those who did. 

4, 4 Tear-off sheet responses 

Attached to each issue of the experimental service was a tear- 
off sheet on which participants were asked to note items of interest 
and how these items were followed up. A specimen sheet is given in 
Appendix £. Participants were asked to keep these sheets and return 
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them ¥iith the questionnaire at the end of the experimental period. 

Of the 129 respondents to the questionnaire 102 returned sheets which 

were at least partially completed. Twenty-seven either did not return 

sheets or returned blank ones. Among these were some who regarded the 

service as very useful ; so non-completion of the sheets does not imply 

that no items were of interest. Three participants returned sheets but 

no questionnaire. There was immense variation in the use made of the sheets. 

Some people noted a large number of items of interest, but either did 

not follow any of them up or, if they did, did not complete the rest 

of the sheet. Others marked very few items and followed them up thoroughly. 

The largest number of items noted by an individual was 130, which was 

16% of the number of items in the service he received; of these, he followed 

up 39, 

A summary of the responses on the sheets broken down by the service 
parameters is given in Tables 14 to 17, Because of the enormous variance 
in individual responses, no great reliance can be placed on these figures* 
However, a few tentative points can be made. The percentage of items 
followed up which proved useful did not increase with the amount of detail 
in the entries, but the proportion of items noted that were followed up 
was slightly higher for services with abstracts. This is consistent 
with the general preference for abstracts over other forms of entry in 
the questionnaire replies (section 4,1), Most participants receiving 
services with titles and keywords said that they would not be satisfied 
with titles alone. They clearly felt that keywords helped them select 
the most relevant items. However, although they noted and followed up 
fewer items than people receiving titles only, the proportion of items 
followed up which proved useful was in fact lower. This puzzling 
result may just be a further indication that none of these figures are 
reliable. Despite the fact that the number of entries in the 1-weekly, 
3-weekly and 9-weekly services was roughly in the ratio 1:2:3 the numbers 
of items noted and followed up are of the same order for the different 
frequencies. The 9-weekly service in fact gave rise to fewer noted 
items and fewer follow-ups, although it covered more material, including 
all that covered by the other services; this is not altogether surprising 
in view of the comments in the questionnaire that the 9*-weekly service 
contained too many items to scan. Useful items from coverage Q were 
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TABLE 14 

TEAR-OFF SHEET RESPONSES BY COVERAGE 







P 




Q 




R 


Overall 




N 


iO 


N 




N 


% 


N 


% 


Sets of sheets used 


36 




30 




39 




105 




Items noted 


1175 




609 




909 




2693 




Average items noted 


32. d 




20.3 




23.3 




25.6 




Items followed up 


4b2 




311 




C /NO 

oOo 




1276 




Average items followed up 


12.8 




10. 4 




12.9 




12.2 




% followed up^ 




39.3 




51. 1 




55«3 




47.4 


Where followed up: 


















Own library 


324 


70. 1 


180 


57.9 


284 


56 • 5 


788 


61.8 


Public library^ 


23 


5.0 


40 


12.9 


55 


10.9 


118 


9.2 


Other 


114 


24*7 


91 


29. 3 


165 


32.8 


370 


29,0 


Useful^ 


321 


69.5 


213 


68.5 


330 


65.8 


864 


67.7 


2 

Not useful 


40 


8.7 


48 


15.4 


62 


12.3 


150 


11.8 


2 

Could not obtain 


68 


14.7 


17 


3. 5 


69 


13.7 


154 


12.1 


2 

Search not complete 


33 


7.1 


33 


10.6 


42 


8.3 


108 


8.5 


Items useful for: 


















Teaching 


69 


21.5 


25 


11.7 


49 


14.8 


143 


16.6 


3 

Research 


98 


30.5 


26 


12.2 


115 


34.8 


239 


27.7 


practice 


86 


26.8 


80 


37.6 


54 


19.7 


211 


24.4 


General knowledge^ 


154 


48.0 


126 


48.0 


186 


56.4 


466 


53.9 




Notes (a) Totals of which percentages are taken are indicated by super- 
scripts as follows: 

1 - items noted 

2 - items followed up 

3 - items useful 

(b) Items marked as followed up but with no furtlier annotation have 
been classed as 'search not complete*. 
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TABLE 15 



TEAR-OFF SHEET RESPONSES 


BY ENTRY FORMAT 

%t 






ADS bfaC b 


VYf %I9 


Citation 


Overall 




N % 


Si To 


to 


N 


Sets of sheets used 


36 


30 


39 


105 


Items noted 


982 


667 


1044 


2693 


Average items noted 


27.3 


^ 22.2 


26.8 


25.6 


Items followed up 


540 


295 


441 


1276 


Average items followed up 


15.0 


9.8 


11.3 


12.2 



% followed up 
Where followed up: 



55.0 



44.2 



42.2 



47.4 



2 

Own library 


306 


56.7 


158 


53.6 


324 


73.5 


788 


61.8 


2 

Public library 


40 


7.4 


48 


16.3 


30 


6.8 


118 


9.2 


2 

Other 


195 


36.1 


89 


30.2 


86 


19.5 


370 


29.0 


Useful 


351 


65.0 


194 


65.8 


319 


72.3 


864 


67.7 


2 

Not useful 


59 


10.9 


46 


15.6 


45 


10.2 


150 


11.8 


2 

Could not obtain 


101 


18.7 


20 


6.8 


33 


7.5 


154 


12.1 


2 

Search not complete 


29 


5.4 


35 


11.9 


44 


10.0 


108 


8.5 


Items useful for: 


















3 

Teaching 


59 


16.8 


36 


18.6 


48 


15.0 


143 


13.6 


^3 

Research 


122 


34.8 


46 


23.7 


71 


22.3 


239 


27.7 


3 

prac Ace 


72 


20.5 


65 


33.5 


74 


23.2 


211 


24.4 


General knowledge^ 


198 


56.4 


94 


48.5 


174 


54.6 


466 


53.9 



Notes: (a) 



(b) 



Totals of which percentages are taken are indicated by superscripts 
as follows: 

1 - items noted 

2 - items followed up 

3 - items useful 

Items marked as followed up but with no further annotation have 
been classed as 'search not complete*. 
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TABLE 16 

TEAR>OFF SHEET RESPONSES BY FREQUENCY 

1-weekly 3'woekly 9-weekly Overall 





N 


% 


. N 


% 


N 


% 


N 


% 


Sets of sheets used 


30 




44 




31 




105 




Items noted 


765 




1288 




640 




2693 






25 5 




2Q. 3 




20-6 




25.6 




iweius xoxxowvQ up 


*i X^ 




v** # 




317 




1276 




A %Fc^ cto 4 ^ Aflfio 1 1 oworl i m 
MVt7Z^agl7 X w&niS XwXXv^Wt?U up 


7 

XO • f 




19-4 




10 2 




12.2 




% followed up^ 




53.8 




42.5 




49.6 




47.4 


Wiit^x^e XUXXUWI7U ups 


















uwn xxox^az^y 


A f o 


ti7- 0 

W f • w 




62 2 


179 

X f A 


54 3 


788 


61-8 


2 

FUDXXC iiorary 


91 


U • w 


42 


7-7 

f • f 




IS. 7 


118 


9.2 


2 


114 
X X t 


97 7 


lti3 
xu«# 




93 


29. 3 


370 


29.0 


Useful^ 


318 


77.2 


343 


62.7 


203 


64.0 


864 


67.7 


2 

Not useful 


43 


10.4 


78 


14.3 


29 


9.1 


150 


11.8 


2 

Could not obtain 


38 


9.2 


73 


13.3 


43 


13.6 


154 


12.1 


2 

Search not complete 


13 


3.2 


53 


9.7 


42 


13.2 


108 


8.5 


Items useful for: 


















Teaching"^ 


55 


17.3 


63 


18.4 


25 


12.3 


143 


16.6 


3 

Research 


87 


21, A 


107 


31.2 


45 


22.2 


239 


27.7 


. 3 
Practice 


61 


19.2 


82 


23.9 


68 


33.5 


211 


24.4 


3 

General knowledge 


194 


61.0 


183 


53.4 


89 


43.8 


466 


53.9 



Notes ; (a) Totals of which percentages are taken are indicated by super- 
scripts as follows: 

1 - items noted 

2 - items followed up 

3 - items useful 

(b) Items marked as followed up but with no further annotation 
have been classed as * search not complete*. 
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TABLE 17 

TEAR-OFF SHEET RESPONSES BY INDEX 







Index 


WW 




Overall 






N 


% 


N 


% 


N 


% 


Sots of shoeti} us6d 




51 




OH 


• 


105 




Items noted . 




1467 








2693 








28.8 




22.7 




25.6 




Items followed up 




t>67 




609 




1276 




Average items followed 


up 


13.1 




11.3 




12.2 




1 

% followed up 






45.5 




49.7 




47.4 


Where followed up; 






• 










Own library^ 




382 


57.3 


406 


66.7 


788 


61.8 


2 

Public library 




57 


8.5 


61 


10.0 


118 


9.2 


2 

Other 




225 

• 


33.7 


145 


23.8 


370 


29.0 


Useful^ 




460 


69.0 


404 


66.3 


864 


67.7 


2 

Not useful 




78 


11.7 


72 


11.8 


150 


11.8 


2 

Could not obtain 




77 


11.5 


i i 




154 


12.1 


2 

Search not complete 






7.8 


56 


9.2 


X wo 


ft 


Items useful for; 
















Teaching 




81 


17.6 


62 


15.3 


143 


16.6 


3 

Research 




133 


28.9 


106 


26.2 


239 


27.7 


Practice^ 




140 


30.4 


71 


17.6 


211 


24.4 


3 

General knowledge 




243 


52.8 


223 


55.2 


466 


53.9 


Notes: (a) Totals of 


which 


percentages 


are taken are 


indicated 


by 





(b) 



superscripts as follows: 

1 - items noted 

2 - items followed up 

3 - items useful 

Items marked as followed up but with no further annotatioro 
have been classed as 'search not complete'. 
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TABLE 18 



RELATIONS IP OP NUMBER OF ITEMS NOTED TO 
NUMBER OF ITEMS COVERED 



Frequency 



Coverage 
Q 



14 441 16 374 
1 - weekly 325 23.3 - 440 27.5 

. 053 . ^^74 

15 798 17 348 12 678 
3 - week;y 622 41.5 362 21.3 304 25.3 

.052 .081 .037 

7 1239 13 540 11 1054 

9 - weekly 228 32.5 247 19.0 165 ii.O 

.026 . 035 . 014 



Note Figures in each cell are arranged as follows; 

a - no. of sets of sheets used c - no. of items covered by service 
b - no. of items noted d - ave. no. of items noted 

e - ave. no. of Items noted/no. of items covered 
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TABLE 19 

REIATIONSHIP OF NUMBER OF ITEMS FOLLOWED UP 
TO NUMBER OF ITEMS COVERED 



Coverage 
Q 



Frequency 



14 441 ^ 16 374 
1 - weekly 154 11.0 - 258 16.1 

.024 . 043 

15 798 17 348 12 678 
3 - weekly 233 15.5 171 10.1 143 11.0 

.019 .029 .018 

7 1239 13 540 11 1054 

9 - weekly 75 10.7 140 10.8 102 9.3 

.009 .020 .009 



Note Figures in each cell are arranged as follows; 

a - no. of sets of sheets used c - no. of items covered by service 

b - no. of items followed up d - ave. no. of items followed up 

e - ave< no. of items followed up/no. of items covered 
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less liKely to be useful for research* while those from services with 
abstracts were more likely to be useful for research. 

Tables 18 and 19 show the relationship between the numbers of 
items noted and followed up to the numbers of items covered by the 
different services. For all three coverage types the proportion of 
material noted and the proportion followed up increase with frequency 
of issues. As would be expected, the proportion of material noted 
and followed up is higher for coverage Q (core materials) than for 
the other coverage patterns. 

4 , 5 Relationship of tear-off sheets responses to user satisfaction 

It might be hoped that the information recorded on the sheets 
would be correlated in some way with the participants* reactions 
to the usefulness of the service. Unfortunately » this hardly appears 
to be the case. 

TABLE 20 

TEAR-OFF SHEET RESPONSES BY LEVEL OF SATISFACTION 



No use Little use Moderately Very 

useful useful 



% of sheets used 50.0 82.5 80.3 76.5 

No. of sheets used 2 33 53 13 

Ave. items noted 6.8 26.1 28.0 28.2 

Ave. items followed up 3.5 12.3 13.8 8.4 

Ave. items useful 2.5 7.4 9.3 6.2 
% items folloved up 

(oi those noted) 51.5 47.1 49.3 28.8 
% items useful 

(of those followed up) 71.4 60.2 67.4 73.8 



The only one of these statist icc which seems to reinforce the 
satisfaction with the service is the percentage of those items followed 
up which were useful. The first column can reasonably be ignored 
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because it includes only two individuals. Broken down by frequency of 
service and by coverage, this statistic is as follows: 

TABLE 21 

PERCENTAGE OF ITEMS FOLLOWED UP WHICH WERE USEFUL, 
BY FREQUENCY AND COVERAGE AND BY SATISFACTION LEVEL 



Little use Moderately Very 

useful useful 

l-weekly 71.9 84.7 69.2 

3«weekly 49.7 65.8 76.1 

9-weekly 56.6 57.1 81.8 

p 54.8 69.7 78.2 

Q 57.0 60.1 47.1 

R 69.5 69.9 61.8 



Although on the whole the percentage of items followed up that 
were useful increases with satisfaction level i it is obviously not a 
reliable predictor. Nor is satisfaction a good indicator of use. 
What is most surprising is that a lower percentage of items noted was 
followed up by recipients of the 3-weekly services than the other frequencies, 
despite the fact that this frequency was preferred. The percentage of 
items followed up that were useful was also lowest for the 3-weekly 
service. 

There are few other real conflicts between the two evaluation 
methods, (the questionnaire, and use as recorded on tear-off sheets) 
but nor is there much agreement. The general satisfaction level may 
be a better guide to the potential market, and the specific use a better 
guide to real value > but, as pointed out, the variation in individual 
recording on the tear-off sheets makes it unsafe to draw any such conclusions 
in this particular case. 
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The choice between wide coverage with no abstracts and limited 
coverage with good abstracts 

This choice is clearly a difficult one. Seventeen respondents 
did not reply and many of these commented on the Cifficulty of the 
decision. One problem is the definition of 'good' when applied to abstracts* 
Responses to this question broken down by nature of work are given 
below. 







W 


, 1 
L 


No reply 


W 

% 


. 1 

L 

% 


Overall 


54 


57 


17 


48.6 


51.4 


P 


(43) 


14 


21 


8 


40.0 


60.0 


TR 


(30) 


15 


11 


4 


57.6 


42.3 


R 


(19) 


12 


7 




63.2 


36.8 


PR 


(17) 


6 


8 


3 


42.9 


58.1 


PTR 


(10) 


4 


4 


2 


50.0 


50.0 


T 


( 5) 


1 


4 




20.0 


80.0 


PT 


( 5) 


3 


2 




60.0 


40.0 


P+ 


(75) 


27 


35 


13 


43.6 


56.4 


T+ 


(50) 


23 


21 


6 


52.2 


47.8 


R+ 


(76) 


37 


30 


9 


55.2 


44.8 



(percentages do not include non-replies) 



Considering the R and TR rows» it appears that practitioners 
favour good abstracts and limited coverage while researchers prefer wide 
coverage. However the difference between the P and TR rows is not significant 
at the 10% level using the 2x2 contingency table test suggested by Cox 
(1970, p,35) or the usual contingency table test. 



W indicates the choice of wide coverage with no abstracts; L indicates 
the choice of limited coverage with good abstracts, 
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Broken down by service parameters, the responses are as follows: 









U7 
W 


T 
U 




w 
If 


1, 




P 


(50) 


20 


23 


7 


46*5% 


53 • 5% 


Coverage 


Q 


(32) 


18 


12 


2 




40, WTO 




K 


V^/ ) 


1 7 
X f 




ft 


43 S% 




m 


A 


(47) 


18 


22 


7 


45.0% 


55.0% 




K 


(40) 


21 


15 


4 


58.4% 


41.6% 


format 


C 


(42) 


16 


20 


6 


44.4% 


55.6% 




1 


(37) 


15 


15 


7 


50.0% 


50.0% 


Frequency 


3 


(49) 


22 


21 


6 


51.2% 


48.8% 




9 


(43) 


18 


21 


4 


46.2% 


53.8% 




N 


(65) 


23 


33 


9 


41.1% 


58.9% 


Index 


Y 


(64) 


32 


24 


8 


57.2% 


42.8% 



(percentages do not include non-replies) 



The differences In the proportions choosing wide coverage with 
no abstracts (ignoring non-replies) for the different service parameters 
are only significant for the index parameter* This difference is significant 
at the 10% level using either the usual contingency table test or the 2x2 
contingency table test suggested by Cox (1970). Respondents who received 
no index tended to prefer limited coverage with good abstracts » while 
those with an index chose wide coverage* This result has no immediate 
ana obvious explanation. There is no bias in the distribution of services 
with index towards researchers rather than practitioners (see section 4«2)e 
Such a bias would have been a possible explanation* One possibility is 
that respondents who received no index answered this question assuming 
that no index would be available^ and therefore chose increased detail 
on a limited amount of material » as being more suitable for a publication 
which has to be scanned rather than referred to through an index* 



Although the difference in proportions for the coverp^e parameters 
is not significant there is a slight indication that recipients of the 
core coverage favour wide coverage* This contrasts slightly with the 
responses to question 12 of the questionnaire (see section 4*1)9 where 

ERIC So 
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fewer recipients of core coverage Q than of coverage P wanted more Journals 
and books to be covered • 

Considering the figures for the different entry formats, It appears 
that users who received keywords favoured wide coverage with no abstracts. 
However, it is likely that these people interpreted *wlth no abstracts* 
as implying *but with keywords 

In conclusion, the choice between wide coverage with no abstracts 
and limited coverage with good abstracts was difficult, and did not appear 
to be greatly affected by variation in the service parameters, except tt^at 
an index seemed to make a user more likely to favour wide coverage. The 
nature of work In which a user is Involved seems to be more important, 
with researchers preferring wide coverage and practitioners good abstracts* 
However this effect is not very strong. 

STATISTICAL ANALYSIS II 

5.0 ANALYSIS FOR LINEAR DISCRIMINANTS AND PRINCIPAL COMPONENTS 

It would be useful to know how well recipients' satisfaction 
with the service could be predicted by other factors. To this end 
it was decided to use linear discriminant analysis to obtain functions 
of other variables which can be used to predict the satisfaction 
level of the respondents. For technical descriptions of linear 
discriminant analysis see Anderson (1958), section d«7, or Kendall 
(1966), chapter 44. It must be borne in mind that this techn-'que 
was developed for normal variables and can only be cbnsidered optimal, 
even in such a case, when further assumptions are made. With discrete 
variables the technique can only be used to obtain discriminant functions 
which should be reasonably good. They can be judged by the results they 
give when applied to the questionnaire data. Ideally the functions 
should be tested on different data from taat used to generate the 
functions, but because of the number of service parameter combinations 
our sample is not large enough to divide for this purpose. 
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6,1 Selection of satisfaction groups and variables for linear 
discriminant analysis 

Since only four respondents described the service as of no use 
to them, these were included with those who considered it of little use* 
Respondents were therefore allocated respectively to group li 2 or 3 
according to whether they found the service of little or no use, moderately 
useful or very useful. 

The variables chosen as relevant to this analysis were: 

(i) Coverage (P, Q, R) 
(ii) Entry format (A, K, C) 
(iii) Frequency (1-, 3-, 9- weekly) 
(iv) Index (Y, N) 

(v) Nature of work (P, T, R) 
(vi) Whether or not an information service is normally used 
(vii) Attitude to frequency of issues (too frequent, about right, 
not frequent enough) 
(viii) Attitude to entry format (not adequate, sometimes adequate, 
completely adequate) 
(ix) Attitude to number of items per issue (too few, about right, 
too many) 

(ic) Attitude to coverage (more/fewer Journals, more/fewer books, 
more/fewer reports etc,) 
(xi) Choice between wide coverage with no abstracts and limited 
coverage with good abstracts. 

Since the questions on attitude to an index were not comparable 
between respondents with and without indexes, they could not be used, 
Variable (xi) was included to detect whether this choice was related 
to satisfaction level. 

5^2 Representation of data for linear discriminant analysis 

Certain problems arise when using discrete data for this type 
of analysis. Given observations (as measured by m variables) which 
fall into k groups (in this case the groups are defined by the 
satisfaction level), linear discriminant analysis generates k linear 
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functions of the m variablos which divido the variable space into 
k non«-overIapping regions* Any observation on these variables can 
be considered as a point In this space and is predicted to be in the 
group associated with the region R in which it is situated. As an 
illustration consider the case of three groups of observations on 
two variables. 




Because the boundaries between the regions are linear it is 
clearly undesirable to assign numerical values to cod^id variables in 
such a way that high and low values are liable to be associated with 
low satisfaction level, and middle values with high satisfaction level. 
This affects our representation of variables (i), (ii)i (iii)i (v)i 
(vii)» (ix)y and (x)* One possible approach would be to treat each 
possible code for these variables as a 0-1 variable. This would also 
obviate the possible need for scaling the numerical values assigned 
to codes I since the relative scaling of different dimensions in the 
variable space is immaterial for linear discriminant analysis* However , 
this approach generates another problem. In the case where one and 
only one of such a set of variables would have the value one> the sum 
of the values for this set of variables would always be one. This 
is a linear dependency among the variables i and the existence of such 
a dependency means that no unique set of discriminant functions can 
be found by linear discriminant analysis* Setting aside this case 
for the moment y the following variables can be treated as 0-1 variables: 

(iv) Index 

(v) Nature of work • 3 variables (p, T, R) 
(vi) Whether or not an information service is normally used 
(x) Attitude to coverage - 4 variables (more journals» more 
books, more reports etc., less of anything) 
(xi) Choice between wide coverage with no abstracts and limited 
coverage with good abstracts* 
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Variable (viii), the attitude to entry format, can clearly be 
ordered suitably - not adequate, sometimes adequate, completely adequate. 
With only three values, and hence only two differences to select, scaling 
is not as important as it would be with more values. With no indications 
that the differences should be different, the three possibilities were 
given values 1, 2 and 3. 

Returning to the cases where one and only one of a set of codes 
is selected, one possibility is to include a 0-1 variable for all but 
one of these codes. As an example for coverage, one 0-1 variable for 
P and another for Q could be used. An observation with 0 for both 
of these variables would correspond by implication to coverage R, 
This approach was tried with the relevant variables as follows: 

<i) Coverage - 2 variables (P, Q) 
<ii) Entry format - 2 variables (A, K) 
(iii) Frequency - 2 variables (1, 3) 

(vii) Attitude to frequency - 2 variables (too frequent, not 
frequent enough) 
<ix) Attitude to number of items per issue - 2 variables (too 
few, too many) 

Results from this first analysis with 22 variables in all are. 
discussed in section 5.3. Because of the lack of symmetry of treatment 
of variables (i), (ii) and (iii), it proved difficult to interpret the 
results and a second approach was tried. Subsidiary discriminant 
analyses using only variables (i) - (v) were performed, with variables (i) 
coverage, (ii) entry format, and (iii) frequency each represented 
by one variable, giving the values 1, 2 and 3 to the three possible 
codes. All possible order ings and combinations of the three variables 
were tried, and the results are given in section 5.4. From these, the 
orderings which gave the best discrimination were chosen and used in 
further analyses with the following variables: 
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TABLE 22 

VARIABLES USED IN PRINCIPAL COMPONENT ANALYSIS AND 
SUBSEQUENT DISCRIMINANT ANALYSIS 



(1) Coverage - Rsl, P8 2, Qs3 

(2) Entry format - Asl, K = 2, C=3 

(3) Frequency - 1-weekly s X, 9-weekly » 2, 3-weekly s 3 

(4) Index - N = O, Y = 1 

(5) Practice s 1 

(6) Teaching =1 ^ nature of work 

(7) Research s 1 

(8) Normally uses Information service s I 

(9) Issues too frequent s 1 

(10) Issues not frequent enough s 1 

(11) Entry format not adequate s sometimes adequate » 2$ 
completely adequate a 3 

(12) Too fe\^ items per issue ss 1 

(13) Too many items per issue s 1 

(14) More Journals » 1 

(15) More books » 1 

(16) More reports, etc, = 1 

(17) Less of anything s 1 



The original variable (xi) was omitted as it did not appear 
from the earlier analyses to be related to the satisfaction level. 
The results are discussed in section 5*6. In all cases, individuals 
who had not answered one or more of the relevant questions were ignored, 

5.3 First discriminant analysis 



As described in section 5.2 the first discriminant analysis was 
performed using 22 variables. The number of respondents who had answered 
all the relevant questions was 103. Three discriminant functions are 
produced, one for each satisfaction groupi such that each observation 
is allocated to the group for which the value of the discriminant 
function is greatest. The coefficients of the functions for this 
analysis were: 
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TABLE 23 

DISCRIMINANT FUNCTIONS FROM FIRST ANALYSIS 





1 


2 

mm 


3 , 


Constant term 


-23.27 


-21.27 


-28.1€f 


p-coverage 


3.90 


4.47 


3.6$ 


Q^coverage 


9.08 


9.33 


11.89 


A-entrles 


0.46 


0.32 


- 1.12 


K'-entrles 


4.60 


3.77 


2.23 


1 -weekly 


7.68 


7.55 


10.18 


3-weekly 


5.60 


5.34 


5.31 


Index 


2.54 


2.45 


1.22 


Practice 


9.42 


9.09 


10.06 


Teaching 


4.30 


4.35 


6.85 


Research 


5.12 


4.83 


6.07 


Uses Information service 


3.21 


3.44 


3.54 


Too frequent 


- 2.22 


- 1.56 


- 1.25 


Not frequent enough 


2.12 


1.36 


3.60 


Adequacy of entry format 


7.20 


6.90 


7.87 


Too few Items 


- 1.69 


- 2.96 


- 4.182 


Too many items 


4.64 


3.67 


4.84 


More Journals 


4.57 


3* 96 


6.92 


More books 


- 0.71 


- 0.43 


- 0.66 


More reports etc. 


3.85 


4.05 


3.45 


Less of anything 


1.53 


1.08 


2.01 


Wide coverage and limited 
abstracts/limited coverage 
and no abstracts 


4.79 


4.22 


4.34 



These functions allocated the observations to groups as follows: 
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Actual group 

1 
2 
3 

Total 



1 

19 
18 
1 

38 



Predicted group 
2 3 
11 4 
32 8 
10 



43 



22 



Total 
34 
58 
11 

103 



55 - 



Of the individuals 59.2% are assigned to their correct satisfaction 
group* This is not in itself a good measure for comparison of Jiscriminant 
functions » since 56*3% would be correctly assigned if all individuals 
were assigned to group 2. The fact that very few individuals assigned 
to group 3 in fact belong to group 1 and vice versa is of value in this 
case. Of those predicted to find the service of little or no use^ only 
one found it very useful » and none of those predicted to find it moderately 
useful found it very useful. 

It is not easy to interpret the discriminant functions. Large 
differences in the coefficients of a variable between the three functions 
clearly imply that that variable is a good discriminator. But one problem 
is that the variables used are not independent » and more important are 
correlated in the data used. For example the variable indicating that 
an individual is Involved in planning practice is quite highly negatively 
correlated with the variables indicating involvement in research and 
teaching. This makes consideration of the difference in coefficients 
of these variables for the three functions confusing. It is almost 
essential to consider them together. For instance an individual who is 
involved only in practice » and another who is involved in both teaching 
and research but not in practice contribute almost the same value to the 
first two discriminant functions but the latter contributes considerably 
to the third discriminant function. Thus someone involved in teaching and 
research is more likely to be satisfied with the service. However, 
the constant term for the third function is more than 3 less than the other 
two constants. What does this mean? Some of these problems of 
interpretation might be avoided if uncorrelated variables could be used. 
One way of obtaining uncorrelated variables is to perform a principal 
component analysis and then use linear discriminant analysis on some or 
all of the principal components. For a technical description of principal 
component analysis see Kendall (1966) chapter 43. Results of these 
analyses are given in sections 5.5 and 5.6. Interpretation of the relation 
of the size of a coefficient to the constant term in a function is also 
tricky. The arbitrary omission of one of a set of codes has constrained 
the coefficients of the corresponding variable to be the same» and zero. 
The effect of this is not clear, and to try to avoid this constraint, 
subsidiary analyses on a reduced set of variables were performed. 
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5.4 Subsidiary disoriroinant analyses 

The variables in consideration fall into two types: state 
variables recording facts, and variables describing attitudes* Whether 
or not an indi^ddial usually uses an information service falls between 
the two types but for this purpose has been classed as an attitude 
variable. Subsidiary analyses were made using the two classes of variables 
separately, and with all possible orderings of the values for the service 
parameters for the class of state variables recording facts* 

TABLE 24 

DISCRIMIN^ FUNCTIONS ON ATTITUDE VARIABLES 



Satisfaction group 


1 


2 


3 




Constant term 


- 7.29 


- 6.14 


- 8.59 




Uses information service 


2.27 


2.25 


1.70 




Too frequent 


0.77 


0.84 


1.24 




Not frequent enough 


2.00 


1.17 


2.81 




Adequacy of entry format 


4.61 


4.49 


4.99 




Too fow items/issue 


0.98 


0.23 


~ 0.35 




Too many items/issue 


2.70 


1.96 


1.95 




More Journals 


2.72 


2.17 


4.55 




Less of anything 


2.37 


1.41 


1.69 




Actual group 




Predicted 


group 






1 


2 


3 


Total 


1 


17 


13 


11 


41 


2 


18 


32 


14 


64 


3 


1 


2 


10 


13 


Total 


36 


47 


35 


118 
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Comparing this allocation with that in the previous section 
Indicates that the attitude variables give xlse to slightly worse 
discriminants than the whole set of variables* 

Considering state variables only, the following orderings gave 
the allocations which looked most reasonable; 



RPQ/ACK/193 
Actual group 

1 
2 
3 



28 
30 
1 



Predicted group 

2 3 



10 
18 
4 



6 
18 
12 



Total 

44 
66 
17 



Total 



59 



32 



36 



127 



RPQ/CAK/193 
Actual group 

1 
2 
3 



28 
29 



Predicted group 

2 3 



10 
18 
4 



6 

19 
13 



Total 

44 
66 
17 



Total 



57 



32 



38 



127 



RPQ/AKC/193 
Actual group 

I 
2 
3 

Total 



28 
32 

60 



Predicted group 

2 3 



10 
15 
3 

28 



6 
19 
14 

39 



Total 

44 
66 
17 

127 



RPQ/AKC/9I3 
Actual group 

I 
2 
3 



30 
31 
1 



Predicted group 

2 3 



8 
16 
4 



6 
19 
12 



Total 

44 
66 
17 



Total 



62 



28 



37 



127 
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It is impossible to choose one of these as best without stipulating 
a criterion that can be measured. The simple criterion, percentage of 
individuals correctly assigned, has values 43.7%, 46.5%, 44.9% and 45.7%. 
If in addition the individuals assigned to a group next to the correct 
one are added in with weight of a half, the values become 70.1, 70.2, 
70.0, 70,0 respectively. This is still an unsatisfactory measure 
because I with only three groups, a high value could be attained 
simply by assigning all individuals to group 2. However it is obvious 
that there is no clear reason for preferring one of these four orderings. 
Arbitrarily the ordering RPQ/AKC/193 was chosen for subsequent analys'^s 
(see sections 5.5 and 5.6). The coefficients of the discriminants 
Jin this analysis were as follows: 

TART,F. 

DISCRIMINANT FUNCTIONS ON STATE VARIABLES 



Satisfaction group 


1 


2 


3 


Constant term 


-16.05 


-16.61 


-17.95 


RPQ 


1.37 


1.63 


2.25 


AKC 


2.79 


2.84 


3.42 


193 


3.56 


3.45 


3.18 


Index 


5.68 


5.57 


4.44 


Practice 


7.30 


7.43 


6.95 


Teaching 


2.59 


3.28 


4.42 


Research 


5.62 


5.74 


6.69 



In general the discriminants generated from the state variables 
were less good than those generated from the attitude variables. 

5.5 Principal component analysis 

Principal component analysis produces from an observation matrix 
a matrix of correlations for the original variables. Linear combinations 
of these variables are then obtained in turn« each one uncorrelated with 
all previous combinations and accounting for more of the variance than 
any other uncorrelated combination. These linear combinations are 
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known as the principal components of the correlation matrix. Usually 
(unless the rank of the correlation matrix is less than the number of 
original variables) the same number of components can be obtained as 
there were original variables » and the components are unoorrelated and 
ordered by their variance in the data. Variables with small variations 
in the sample data are not likely to be very useful for discrimination! 
(although counter-examples can easily be produced)! and so it is reasonable 
to ignore the last few components in subsequent discriminant analyses* 

The variables used in this particular analysis were the seventeen 
variables listed in Table 22 (section 5.2). The correlation matrix is given in 

Table 26 » and the coefficients of the components and the percentage of 
the total variance accounted for by each component are given in Table 27. 

The two highest correlations are negative correlations of those 
involved in practice with those involved in teaching and research. This 
corresponds to the result (section 4.1) that one third of the respondents 
were involved only in planning practice » and another third in research 
only or teaching and research. The next highest correlation is perhaps 
more interesting; there is a correlation of .42 between those who want 
coverage of more journals and those who thought that issues contained 
too few items. This suggests that many of the people who said that issues 
contained too few items did so partly because they felt that the coverage 
was not wide enough rather than because the issues were too small to be 
worth scanning. This feeling might be due to the fact that if a user 
is interested in the articles in a specific Journal » many of which are 
published quarterly or less frequently, there may be several issues 
without any entries from this journal. In v-*! ticular , for our experiment 
the weekly service was run for a period ol nine weeks. Many quarterly 
journals will not have been published in this period and therefore will 
not appear to have been included in the coverage. This is borne out by 
the fact that 56.8% of those receiving the wdekly services wanted more 
journals covered, opposed to 46.3% of those receiving the three- 
weekly services and J4.9% of those receiving the nine-weekly services. 
This is despite the fact that there was no weekly service covering only 
core material. This suggests that a list of journals covered by a service 
would be desirable with a frequent service. The only other correlations 
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ixbove .25 which indicate results not directly shown in section 4.0, are 
that researchers are correlated with those using information services 
(•33), and those who want more Journals covered are positively correlated 
(•28) with researchers and negatively correlated (-.28) with practitionerst 

It is useful, though clumsy, to try and describe the principal 
components in words, by selecting the largest coefficients in each 
component. An attempt is made below to do this for the first few components • 
It must be remembered that on components with high variance many individuals 
will be at one or other extreme of its range. Codes for the service 
parameters are ordered so that the last code corresponds to the highest 
score. 

Principal components 

(1) Practice, no research, does not want more Journals, does 
not feel issues have too few items 

(2) 'Entry format (AKC), does not feel issues have too many items 

(3) Frequency (193), coverage (RPQ), does not thinl^. issues too 
frequent, adequacy of entry format ( ve) 

(4) Does not use information service, does not want more reports, 
coverage (RPQ), teaching 

It must be stressed that, although the first component has the 
greatest variance in the questionnaire data, this does not imply automatically 
that this is the best linear combination of the original variables 
for -predicting satisfaction with the service. Techniques have been 
developed for finding such a combination but, '*it appears that, in general, 
the use of one function for discrimination among several populations may 
be rather Procrustean unless they are so separate that almost any method 
will yield reasonable results*'. (Kendall, 1966). 

5.6 Further discriminant analyses 

The principal components obtained as described in section 5.5 were 
then used as variables for three further linear discriminant analyses, 
using ten, thirteen and seventeen of the principal components. The 
first ten components account lor 80% of the variance, the first thirteen 
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for 90% and the full seventeen clearly account for all the variance. The 
tables of predicted groups against actual groups are given below. 



Using ten principal components 
Actual group Predicted group 



I 
2 
3 

Total 



1 
19 
18 

37 



2 
13 
30 

3 

46 



3 
9 
16 
10 

35 



Total 
41 
64 
13 

118 



Using thirteen principal components 
Actual group Predicted group 



1 

2 • 
3 

Total 



1 
20 
16 

36 



2 
13 
35 

1 

51 



3 
6 
13 
12 

31 



Total 
41 
64 
13 

118 



Using seventeen principal components 
Actual group Predicted group 



1 
2 
3 

Total 



1 
20 
19 

39 



2 
17 
33 

1 

51 



3 
4 
12 
12 

28 



Total 
41 
64 
13 

118 
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Discrimination using only ten components is not as good as that 
using thirteen or seventeen. Considering these two cases » the first predicts 
the satisfaction of two more individuals correctly i and the second is 
slightly less optimistic than the first in that it predicts fewer people 
as being very satisfied. It may seem odd that using more information a 
slightly worse result (in terms of correct predictions) can be obtained i 
but as remarked before the number of correct predictions is not a suitable 
function to maximize. More correct predictions would have been made 
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by predicting everybody as finding the service moderately useful. It 
appears that as expected the last four components contribute no discrim- 
inating power and further discussions will concentrate on the analysis 
using thirteen components. The coefficients of its discriminant functions 
were : 

TABLE 28 

DISCRIMINANT FUNCTIONS ON THIRTEEN PRINCIPAL COMPONENTS 



Satisfaction group 


1 


2 


3 


Con: tant 


term 


-17.60 


-17.46 


-19.29 


Component 


1 


- 0.85 


- 0.93 


- 1.96 


tt 


2 


0.41 


0. 53 


0.22 


ff 


3 


2.04 


1.87 


2.39 


»♦ 


4 


- 1.02 


- 0.54 


0.43 


tt 


5 


- 4.04 


- 4.00 


- 2.88 


tt 


6 


- 2.69 


- 2.29 


- 2.65 


tt 


7 


2.36 


1.38 


3.06 


II 


8 


- 0.26 


- 0.78 


0.48 


ti 


9 


2.46 


1.66 


1.69 


ti 


10 


1. 19 


1.00 


0.94 


tt. 


11 


0.28 


0. 27 


- 2.40 


tt 


12 


10.80 


10.87 


11.72 


tt 


13 


- 0.97 


1.73 


- 0.62 



The components which are roost powerful in discriminating between 
satisfaction groups are those in which one or more of the differences 
between the coefficients are large. The largest differences are between 
groups 1 and 3 (2.68) and 2 and 3 (2.67) for component 11. To have a low 
value for component 11 an idividial must teach and not use an information 
service and probably think that issues were not frequent enough. Such 
an individual will be more likely to be very satisfied, than one with 
the opposite characteristics, other things being equal. However, since 
the con-^tant term for furction 3 is considerably less than that for 
the other functions, it is probably necessary for several of the components 
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which can discriminato in favour of group 3 to have suitable values before 
an individual is predicted to be in group 3. Component 7 has a difference 
of 1,68 between its coefficients for groups 2 and 3» but a much smaller 
difference, .70, between groups 1 and 3, This implies that someone 
with a high value for component 7 (someone who had several of the 
following qualities: did not receive an index; found the entry format 
adequate; wanted more books; wanted more Journals; did not want more 
reports; wanted less of anything) was more likely to have found the service 
either very useful or of little or no use, and less likely to have found 
it of some use.' This example highlights the fact that although using 
principal components avoids problems of correlated variables it can 
still produce perplexing problems of interpretation. The three functions 
of components can be transformed into functions of the original variables 
as follows: 

TABLE 29 

DISCRIMINANT FUNCTIONS FROM TABLE 28 TRANSFORMED BACK 
TO THE ORIGINAL VARIABLES 



Satisfaction group 


1 


2 


J 


Constant teiiii 


-17.60 


-17.46 


-19.29 


Coverage (RPQ) 


2.29 


2.35 


2.71 


Entry format (AKC) 


2.67 


2.74 


3.39 


Frequency (193) 


2.72 


2.82 


2.40 


Index (NY) 


3.66 


3.85 


2.14 


Practice 


- 1.74 


- 1.64 


- 2.01 


Teaching 


- 1.61 


- 1.03 


0.66 


Research 


- 1.31 


- 1.48 


- 1.01 


Uses aformation service 


0.49 


0.61 


- 0.43 


Too frequent 


2.94 


2.91 


2.80 


Not frequent enough 


5.81 


5.01 


7.44 


Adequacv of entry format 


5.74 


5.71 


6.33 


Too few items/issue 


0.04 


- 0.43 


- 0.13 


Too many items/issue 


- 2.85 


- 3.53 


- 3.64 


More Journals 


- 0.31 


- 0.98 


0.61 


More books 


0.90 


0.67 


0.71 


More reports 


4.74 


4.95 


4.53 


Less of anything 


3.43 


2.59 


3.02 



- 66 - 



The differences between the coefficients of the variables for the 
three groups are mostly o." the same order as those in the two subsidiary 
analyses (see section 5«4)« A comparison of these functions with those 
obtained in the first analysis (see section 5«3) would show up any large 
effect on the comparable variables of the different representation of 
the service parameters > and the use of principal components as opposed to 
the original variables* The overall performance of the two sets of 
discriminant functions is very similar* The important factors for comparison 
of the coefficients are the ordering of the three coefficients for each 
variable and the size of the differences between these coefficients* 
Considered in this way the coefficients for the practice, teaching and 
research variables differ greatly between the two analyses* This 
might be expected because of the high (positive or negative) correlations 
between these variables* For the other variables the ordering of the 
coefficients are mostly the same, but the sizes of the differences vary* 
Looking at the individual allocations, there is good agreement in the 
predictions for people actually in groups 1 and 3, but for about 40% of 
those actually in group 2 the predicted groups differ between the two 
analyses* The implication is that the functions obtained are probably 
not very stable i and depend on the particular data used* 

5* 7 Overlap between predicted satisfaction levels 

It is particularly simple where allocation of observations to classes 
is made by comparison of function values for each class, to consider 
overlap between classes* An observation can be considered to lie in the 
overlap between two classes if the difference between the highest function 
value and one of the others is less than a certain value* An observation 
lies in the overlap of several classes if the range of corresponding function 
values is less than the chosen value* 

Using the discriminant functions obtained in the last analysis (see 
section 5»6), and overlap values of 0*5 and 0*25 the following extended 
tables of predicted satisfaction levels are obtained* 
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Actual 


group 






Predicted 


group 


(overlap 


value 0.5) 






1 


(1.2) 


2 


(2,3) 


3 


(1 3) 


(1,2,3) 


1 




13 


16 


5 




3 


1 


3 


2 




7 


24 


15 


6 


6 


1 


5 


3 






1 




2 


9 




1 


Actual 


group 






Predicted 


group 


(overlap value 0.25 






1 


(1,2) 


2 


(2,3) 


3 


(1,3) 


(1,2,3) 


1 




16 


8 


10 


1 


4 


1 


1 


2 




12 


13 


25 


1 


9 


2 


2 


3 








1 


1 


11 







The percentage of individuals predicted to be in incorrect groups, 
or overlaps not including the correct group is 43.2% allowing no overlap, 
33.1% with overlap value 0.25, and 19,5% with overlap value 0.5. 

One interesting point is that the method of discriminant analysis 
does not assume any particular relationship between the groups, so there 
is no reason why the method should produce more overlap between groups 1 
and 2 than between groups 1 and 3, It appears that the factors which 
determine whether someone finds the service of little use or moderately useful 
are more complicated than the factors which determine whether the service is 
very useful. 

5.8 Conclusions from principal component and linear discriminant 
analyses 

It had been hoped that these analyses might show a few factors to 
be of great importance in determining the usefulness of an information 
service of this kind. Unfortunately this was not the case. People's 
requirements clearly vary considerably. The analyses accentuated the fact 
that the sample, and therefore probably the class of planners, contains 
two main groups of people: those doing research and possibly teaching, who 
want maximum coverage; and those who are practising planners and find 
compact information on core material most satisfactory. It appears that 
on the whole the first category are more likely to find a service similar 
to this experimental one useful» and independent of this split those who 
^ teach and do not normally use an information service would find it useful. 
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Apart from this a few points can bo made. More coverage than required 
made the service less useful. Adequacy of entry format was quite 
highly correlated with increase in detail of items. The attitude to the 
adequacy of the entry format appears to be more important than the 
entry format itself in determining satisfaction. The inclusion of an 
index was not associated with increased satisfaction. In fact ^0 
reverse was true. 

Frequency and attitudes to it appear to have no consistent effect 
on satisfaction, since the different analyses give different relative 
orderings of the coefficients of these variables. This may be because 
other factors, affected by frequency, such as size of issue, currency 
of material, or an individual's usual method of keeping up with the 
literature, are in fact more important in determining satisfaction. 
When considered separately the attitude variables gave rise to better 
discriminators than the state variables, 

6,0 SUMMARY AND CONCLUSIONS 

The objective of the experiment was to discover how the usefulness 

of an abstracting or indexing journal varies with the type and style of 

the publication. However the study also showed some clear distinctions 

between what users thought that they wanted and what they in fact found 

useful. The experimental service, in forty-eight different publication 

styles, was distributed to 192 planners employed in research and teaching 

and in planning practice. Each participant received one publication 

style, and the four parameters varied were coverage, content of entry, 

frequency of publication and inclusion of an index. For evaluation 

a tear-off sheet was attached to each issue and a questionnaire was 

sent with the final issue (see Appendix E), In all, 129 people returned 

questionnaires, of whom 102 also returned sheets which were at least 

partially completed. There were 3 people who returned sheets but no 

questionnaire. The response rate for the questionnaire was 68%, and that 

for the sheets 55%. Of the questionnaire respondents 59% normally used 

an information service. Of the respondents 58% were to some extent involved 

in planning practice, 59% in research and 39% in teaching. One- third 

O . were engaged only in practice, with 23% doing research and teaching and 
ERJC 
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15% doing research only. All the analyses emphasized the difference in 
requirements between practitioners and academics. Those teaching and 
doing research were on the whole more satisfied with the service i and 
wanted greater coverage, and more of them thought there were too few 
items per issue. They were also more likely (about 60% as opposed to 
40% for practitioners) to prefer wide coverage with no abstracts to 
limited coverage with good abstracts. 

There appears to be a complex interactive effect of changes in 
frequency and coverage. There is a much greater variation in the 
proportion of people wanting coverage of more journals when broken down 
by frequency than when broken down by coverage of the service received 
(57% of those receiving weekly seivice, 17% for 3-weekly services, and 
35% for 9-weekly services: 50% for general coverage, 47% for core coverage » 
and 40% for urban planning coverage). This may be due partly to a 
constraint of the experiment in that some Journals published quarterly 
or less frequently will not have been covered in the nine week period of 
the weekly services. An individual interested in some of these journals 
might notice these omissions and assume that the" were not included 
in the coverage. Several respondents suggested that a list of journals 
covered would be desirable. Changes in frequency and coverage also affect 
the number of items in each issue. It is clear that the volume of material 
in an issue is an important factor, at least for a service sent to 
individuals and intended for keeping pace with current material, rather 
than one held by libraries for retrospective literature searches. Some 
62% of recipients of the services with about 400 items per issue thought 
that this was too many, as opposed to 26% for sor vices with about 150 
items per issue and 8% for services with about 50 items per issue. 
These small issues were thought to contain too few items by 36% of recipients. 
Almost half the recipients of weekly services thought they were too 
frequent, while about 70% of those receiving three-weekly and nine-weekly 
services thought the frequency of the service received was about right. 

Most people consider that increased frequency of issue is not 
desirable at the expense of increased coverage or inclusion of abstracts 
and indexes. However, i9% of respondents would prefer a fortnightly 
service without abstracts and with rudimentary index to a two-monthly 
service with full abstracts and indexes. About the same number would 
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be prepared to pay extra for a fortnightly service with titles only and 
a keyword index* to supplement a two-- monthly service with good abstracts 
and indexes^ Results from the tear-off sheets are unreliable because of 
the poor response rate (55%) and the enormous variance in the use made 
of the sheets. However » the proportions of material covered which were 
noted and followed up both increased with frequency of issue. This 
indicates that, although most people did not regard increased frequency 
as important y small frequent issues are probably more thoroughly read 
than larger issues, and perhaps prompt more frequent visits to a library. 
The proportion of items followed up which proved useful was in fact highest 
for the weekly services. However, the proportion of these items useful 
for general knowledge rather than directly for practice, research or 
teaching increased with increasing frequency of issue. The discriminant 
analyses showed no consistent effect of frequency, or the attitudes to 
frequency on overall satisfaction. It therefore appears that the effect 
on usefulness of increased frequency is complex. Scanning frequent 
issues and vists to libraries are time--consuming and although a greater 
number of useful items may be found most people (77%) would like a service 
to be no more frequent than monthly. 

The three types of coverage in the experiment were the normal 
coverage in section F of Geo Abstracts (P), core material only (Q), 
and urban planning material from a wider range of sources (R). Under 
10% of respondents wanted fewer journals, books or reports covered, while 
46% wanted more journals covered, 38% more books and 61% more reports. 
Broken down by coverag pe the^e figures were very similar for P and Q 
coverage while fewer recipients of the urban planning service (R) wanted 
more Journals covered, and more wanted more books and reports covered. 
Despite the considerable demand for greater coverage more recipients 
of the core coverage (Q) were very satisfied with the service as a whole. 
There were indications from the tear-off sheets that the P and R coverages 
w' re more useful for research while the Q coverage wai more useful for 
practice. Coverage received was not very important in predicting satis- 
faction level. The choice between wide coverage with no abstracts and 
limited coverage with good abstracts was a difficult one. Overall, 49% 
preferred wide coverage and 51% good abstracts. Practitioners slightly 
favoured aLs tracts and academics favoured wide coverage. This emphasizec the 
different requirements of these two groups. 
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Expressed preferences on entry content also differed from the 
evaluations of usefulness. Most respondents expressed a preference 
for abstracts over titles with or without keywords i although quite a few 
found, or thought they would find, titles with keywords satisfactory. 
However, those receiving services with abstracts were not- more satisfied 
with ♦•.e service as a whole. In fact, more recipients of services with 
titles only found the service very useful, and this was reflected in the 
effect of entry format on the discriminant functions. Results from the 
responses on the tear-*off sheets are unreliable because of the great 
variance between individuals in their use of the sheets, but the proportion 
of items noted that were followed up was slightly higher for services with .1 
abstracts. However, the same ratio was lower for services with keywords 
than for services with titles only. The proportion followed up that was 
useful, was in fact highest for the services with titles only. 
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Another parameter for which expressed attitudes were not borne 
out by satisfaction with service was the inclusion or not of indexes. 
The author index was used by only 22% of recipients of services with 
indexes, and most of those who did not use it said that they did not need 
to. The subject index was used by 53% and seven of those not using the 
index (26%) did not use it because it was not easy to use. Of those 
who did not receive an index, 80% said 'chey would like an index, and 87% 
of those wanted a subject index. Only 17% required an author index. However 
the Inclusion of an index did not increase satisfaction with the service. 
In fact 12 (19%)of those receiving no indexes found the service very 
useful as opposed to 5 (8%) of those receiving indexes. This discrepancy 
may be partly accounted for by the type of index provided (see Appendix 
G(4)). There was considerable demand for a more reliable subject index 
and for grouping of items under broad subject headings. A related point 
is that several people suggested that the title, rather than the author, 
should be prominent in the entries (see Appendix G(l-3)). The proportion 
using or not using the index did not vary noticeably with the frequency 
of the service; this is somewhat surprising, because the nine-weekly 
issues contained about 400 items and the weekly issues about 50 items. 
This is probably because although an index is obviously essential when 
searching retrospectively for literature on a particular topic, it is 
often unnecessary for keeping up with current literature. Grouping 
under broad subject headings is probably more helpful, 
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Results from the discriminant analyses were rather disappointing 
in that it did not prove possible to predict accurately overall satisfaction 
with the service from other factors, either from service parameters 
or from attitudes to particular features of the services. This reinforces 
the hypothesis that people require very different features in information 
services. The most important factor in determining satisfaction appeared 
to be the type of work. Academics were more satisfied than practitioners. 
There was also some indication that those who did not normally use an 
information service were more impressed than those who did. In particular 
some people commented that the D epartment of the Environment Library 
Bulletin was more suited to their requirements, and these people clearly 
did not find the service very useful. Satisfaction could be predicted 
better from attitudes to the service received than irom the values of the 
service parameters. 

An important point to emerge from this experiment was that academics 
and practitioners require different qualities in an information service. 
These differences appeared more important than variations in coverage, 
entry content and frequency and whether an index is included in determining 
satisfaction with the service. On the whole academics want coverage 
to be as wide as possible, while practitioners are unwilling to waste 
time following up items which are difficult to obtain and would prefer 
more compact issues. 

One final point is worth noting. Information scientists have 
a natural tendency to assume that the usefulness of an abstracting or 
indexing journal increases with the effort and expensa put into full 
abstracts and complex indexes. This assumption is reinforced by surveys 
of user opinions; given a choice most users ask for all the options, 
yet this study has shown that for current awareness, users get greater 
satisfaction from a simple publication which is easy to scan quickly. 
The measureable difference in satisfaction is not great, but it is 
significant and the best secondary service is not necessarily the most 
expensive. 
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JOUHNAUS AUSTRACTEl) FOR Q (CC3RE) COVERAGE 



American Economic Review 

American institute of Architects Jouruuls 

Annales de Geographie 

Annals of the Association of American Geographers 
Architectural Review 
L*Architecture d *Aujourd *hui 

Association of American Geographers Commission on College Geography 
Resource Papers 

Building 

Built Environment 

The California Geographer 
Casabella 

Chartered Institute of Transport Journal 

University of Chicago Department of Geography Research Papers 
City 

Civil Engineering ASCE 
County Councils Gazette 

Design 

Economic Geography 
Economics of Planning 
Ekistics 

Geoforum 

Geografiska Annaler B 
Geographical Analysis 
Geographical Review 

Housing Review 

International Journal of Environmental Studies 

Journal of Environmental Planning & Pollution Control 
Journal of the Irrigation & Drainage Divigion ASCE 
journal of Leisure Research 

Journal of Professional Activities Engineering Issues ASCE 
journal of the Royal Town Planning Institute 
Journal of the Sanitary Engineering Division ASCE 
Journal of the Urban Planning & Development Division ASCE 

Land Economics 
Landscape Architecture 
Long Range Planning 

Municipal Journal 
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Options Moditorraneennes 

petermanns Geographlsche Mlttullungen 
Plan (Sweden) 
Planning (ASPO) 
Planning Outlook 
Public Management 

Regional & Urban Economics 
Regional Studies 

Social Trends 

Socio-economic Planning Sciences 
Surveyor 

Technological Forecasting & Social Change 
Terra 

Tidschrift voor Economische en Sociale Geografie 

Town & Country Planning 

Town Planning Quarterly 

Town Planning Review 

Traffic Engineering 

Transportation 

Transportation Engineering journal ASCE 
Transportation Research 

Urban Land 

Urban Land Institute Research Monographs 

Urban Studies 

Urbanisme 

Water Research 

Zeitschrift fiir Wirtschaf tsgeographie 
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Linear programming for urban development plan evaluation. 

CHARLES D, LAIDLAW (Praeger) 

Envlrotunontal planning; an economic analysis. 

JAMES C. HITE & EUGENE A, LAURENT (Praeger) 

After the Planners. 

ROBERT GOODMAN (Penguin) 

Report of the Commission for the New Towns '972. 
American Society for Planning Officials Yearbook 1971. 
Planning for urban growth. 

Sjl JOHN L. TAYLOR (Praeger) 

Reports of the Scottish New Town (listed) Development Corpora-* 
tions for 1972. 

Analytical models for urban and regional planning. 

IAN MASSER (David & Charles) 

Spatial planning in the small economy: a case study of Ireland. 

HELEN B. O'NEILL (Praeger; Pall Mall) 

Problems in Polish economic planning: continuity, change and 
prospects . 

GEORGE R. FEIWEL (Praeger) 

Governing the London region. 

FONALD L. FOLEY (U. Calif) 

Battle for the environment. 

TONY ALDOUS (Fontana) 

Reform of motropolitan t^ovornmouts. 

S. ERIE ii OTHERS (Regional Resources 

for the Future) 

American city planning. 

MEL SCOTT (U. Calif) 

New tools for urban management. 

RICHARD S. ROSENBLOOM & JOHN R. RUSSELL (Harvard U.P'. ) 

Land use planning. 

E.F. ROBERTS (M. Bender) 

Urban space and structures. 

ed LESLIE MARTIN k LIONEL MARCH (Cambridge U.P. ) 

Urban renewal 1971 ' 
od STANLEY MILLWARD (U. Salford^ 

City classification handbook: methods L applications. 

ed n.J.L. BERRY KATHERINE B. SMITH (Wiley) 
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8U unl .American Inst . Planners 

59 Papers 6 Proc . Regional Science Assoc. 

55 Annuls Assoc. American Geographers 

55 Amt ."ican Sociological Review 

5** Anicrican Economic Review 

Geographical Review 
UO . Jnl. Regional Science 

37 Jnl. Royal Town Planning Inst. 

36 Land Economics 

33 Review Economics 8 Statistics 

32 American Jnl . Sociology 

31 Jnl. Royal Statistical Soc. 

30 Urban Studies 

30 Jnl. Political Economy 

28 Jnl. Transport Economics £ Policy 

27 Architects Jnl. 

27 Econometrica 

27 Economic Jnl. 

26 Town Planning Review 

25 Highway Research Record 

2U Economic Geography 

23 Regional Studies 

20 Traffic Engineering S Control 

19 Rural Sociology 

17 American Jnl .Agricultural Economics 

17 Social Forces 

17 Trans. Inst .British Geographers 

16 Jnl. Social Issues 

15 Quarterly Jnl .Economics 

14 Lund Studies in Geography 

14 Oxford Economic Papers 

13 Traffic Quarterly 

12 ' Economic Development S Cultural Change 

12 Management Science 

11 Demography 

11 Human Relations 

11 Law S Contemporary Problems 

11 Official Architecture S Planning 

11 Science 

10 Jnl. Forestry 

10 Operations Researcl; 

10 Photogrammetric Engin< ring 

10 Southern Economic Jnl. 

9 American Political Science Review 

9 Geographical Analysis 

9 Jnl .Acoustical Soc. America 

9 Jnl. American Statistical Assoc. 

9 Review Economic Studies 

9 Tijdschrift Economische Sociale Geografie 

9 Town 6 Count'^y Planning 

8 Agricultural History Review 



X 
X 
X 

X 



X 
X 



X 
X 



X 
X 



section 

C. 

X 
X 

X 
X 

V 

X 
X 



X 

X 



X 
X 
X 
X 
X 

X 
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X 
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8 Geografiska Annaler 

8 Geographical Jnl. 

8 Jnl. Inst .Water Engineers 

8 New Society 

8 Transportation Research 

American Jnl. Public Health 

Annals American Academy Political S Social Science 

Daedalus 

Environment & Planning 
Geography 
Landscape 
National Tax Jnl. 

6 Economic Trends 

6 Proc. Inst .Civil Engineers 

6 Scientific American 

5 Administrative Science Qtly. 

5 American Behavioral Scientist 

5 Archiv. fur Meteorologie Geophysik Bioklimatologie 

5 Jnl. Abnormal S Social Psychology 

5 Manchester School Economic S Social Studies 

5 National Institute Economic Review 

5 Natural Resources Jnl. 

5 Operational Research Qtly. 

5 Professional Geographer 

5 Water Pollution Control 

k Archives Environmental Health 

U Dept . Employment Gazette 

U Ecology 

U Farm Economist 

U Internat . Social Science Jnl. 

h Jnl. Sound 8 Vibration 

U Modern Tramway 8 Light Railway Review 

M Monthly Labor Review 

U Papers Peace Research Soc. 

U Revue Economique 

U Scottish Jnl. Political Economy 

U Social Problems 

U Sociological Inquiry 

^ Sociological Qtly. 

U Trade 6 Industry 

U Weatherwise 

U Western Ejonomic Jnl. 

U Westminster Bank Review 

3 American Sociologist 

3 Arena 

3 ASPO Newsletter 

3 Behavioral Science 

3 Bull. Oxford Univ. Inst . Statistics 

3 Canadian Geographer 

3 Economica 

3 Economie Appliquee 

3 Ekistics 

3 Fortune 

3 Geograpliical Magazine 

3 Harvard Business Review 

3 Inquiry " , 

3 Jnl. Agricultural Economics 

3 Jnl.Econrijp-5 r a-if^mn^f k^ r 
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3 Jnl. Human Resources 

3 Jnl. Social Psychology 

3 Monthly Weather Review 

3 Nature 

3 Pacific Sociological Review 

3 Proc .Assoc .American Geographers 

3 Proc. Highway Research Board X X 

3 Public Opinion Qtly. 

3 Science Jnl. " 

3 Scottish Geographical Magazine X 

3 SIAM Jnl. Applied Mathematics 

3 Solar Energy 

3 Surveyor 

3 Tokyo Jnl. Climatology 

3 Traffic Engineering 

3 Trans-Action 

3 Trans .American Geophysical Union 

3 Trans . Bartlett Soc. 

3 Water Resources Research X X K 

2 AIP Newsletter 

2 American Forests 

2 American Jnl . Psychology 

2 American Psychologist 

2 Annals Mathematioal Statistics 

2 Antiquity 

2 Appraisal Jnl. 

2 Architect 8 Building News 

2 Arctic 8 Alpine Research 

2 Arkitektur 

2 Biometrics 

2 British Jnl . Industrial Relations 

2 Bull .American Meteorological Soc. 

2 Bull .Geological Soc. America X 

2 Bull . Internat . Statistical Inst. 

2 Bull. Quantitative Data for Geographers 

2 Canadian Jnl i Agricultural Economics j, x 

2 Chartered Surveyor XX 

2 Christian Science Monitor 

2 Chronique Sociale de France 

2 Climatological Bulletin (McGill Univ) 

2 College 8 Research Libraries 

2 East African Economic Review 

2 East Yorks. Local History Soc. 

2 Economic History Review 

2 Ecjnomist 

2 Food Research Inst. Studies X 

2 For<^i;Tn Affairs 

2 Gorontologia Clinica a 

2 ii-aith Sorvicen Research 

2 no ] c-oiaonder Wissenschaf tliche Meeresuntersuchungen 

2 Human Orjv^ni 55at ion 

2 Iridu.striai 8 Labor Relations Review 

2 Irt<irnat . F-cononic i<cview 

2 Internat .Jnl . Biometeorology 

2 Internat . Review Community Development \ 

2 Irish Geography 

2 Jnl. Air Pollution Control Assoc. 

9^-2 Jnl. British Waterworks Assoc. 
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2 Jnl. Business Univ. Chicago 

2 Jnl. Geography X 

2 Jnl. Geology 

2 Jnl. industrial Economics X 

2 Jnl. Law & Economics 

2 Jnl. Marketing 

2 Jnl. Marriage S the Family 

2 Jnl. Politics 

2 Kyklos 

2 Metroeconomica 

2 Midlands Industry 8 Commerce 

2 Milbank Memorial Fund Qtly. 

2 National Banking Review 

2 Past 5 Present 

2 Petermanns Mitteilungen 

2 Population Bulletin 

2 Population Studies x 

2 Proc .American Statistical Assoc. 

2 Proc. Soc. Water Treatment 8 Examination 

2 Psychological Review 

2 Public Administration Review 

2 Public Welfare 

2 Qtly .Bull. Research 8 Intelligence Unit G.L.C. 

2 Race 

2 Roads 8 Road Construction 

2 Saturday Review of Literature 

2 Schweizerische Zeitschrift filr voikswirts, & statist ik 

2 Social Science Qtly. 

2 Social Work 

2 Sociological Analysis 

2 Sociology 

2 Sociology 8 Social Research 

2 Survey of Current Business 

2 Time . 

2 Urbanistica 

2 Welfare in Review 
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APPENDIX D 

ANALYSis OF COVERAGE OF GEOGRAPHICAL ABSTRACTS 

(i) GEOGRAPHICAL ABSTRACTS: SECTION C ECONOMIC GEOGRAPHY 

Number of articles contributed from serial titles covered in 
1970 and 1971 

Number of Articles Title 



HI Zcnlschrift fUr Wirtschaf tsKoographie 

•II Soviet Geography, Ueviow and Translation 

43 Voprosy Goosrafii 

•11 Ilevue do Geographic de Lyon 

39 Skillings' Mining Review 

39 Urbanisme 

38 Mitteil, der Oosterr, Geog* Ges. 

38 Probl, Razvitiya Proizvodit sil Bashkir ii 

37 Acta Geographica (Pa'^is) 

37 KkoMomichna Geografiya, Mizhvidorachyi Naukovyi Zbirkyk 

35 Journal of Regional Science 

35 Rozmishch Produkti vn.sil UUSU Resp. Mlsrhvld 

34 Regional Studies 

33 Geographisch » Rundschau 

32 L' Information Geographique 

32 Land Economics 

31 Bulletin dp la Socxete Languedocionno de Geographie 

30 Terra 

29 Journal of Agricultural Economics 

28 Annals Assoc. Amor. Geogs, 

28 Uotail Business (EIU) 

26 Ticonomic Geography 

20 Proc. Assoc. American Geographers 
24 Marketing in Kurope 

23 Cahiors d'Outre-Mer 

23 Hommos et Torres du Nord 

22 Goographia Polonica 

22 Geographical Review 

21 brban Studies 

21 Water Rosourcos Ilosoarch 

20 Kconomio Uu ralo 

20 Official Architecture and Planning 

20 Tijdschrift voor Kconomischo en soci^ale Geografie » 

19 Potroloum Press Service 

10 Transactions Institute of British Geographers 

18 Ad Novas - Norwo^^ian Geog. Studies 

18 Annalos <le Goo^^raphie 

18 Industries et Trava-r. d "Outre \1* r 

18 Tasmanian Journal of Agriculture 

18 Turk I sh Kconomic Review 

17 Cliar ter(>d Survoyor 

17 Industrial Aro»»'"'>i'» ^ 

17 Journal of the Town Planning Institute < 

17 Mr*d 1 lr»rran<^o 

17 Njtois 

17 I/Uruv^r.^f- 

lb G^yj^rajlii al Rcjvh'W Japan 

O IG Town Planning Uolfiow 

ERJC 15 aanco di Roma. Review of Economic Conditions in 

™°™^ Italy 
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I'l 
14 

i:\ 
I a 
la 

13 

i:i 

12 
12 
12 
11 
11 
11 
11 
11 
10 
10 
10 
10 
10 
10 
10 
9 
9 
9 
9 
U 

'J 
9 
9 
9 
9 
8 
8 
8 

8 
8 
8 
8 
8 
7 
7 

I 

7 

7 
/ 
7 
7 
6 



A«N,Z. Hnnk Quarterly Survey 

Ooojjraphy 

Vostnik Loningradskogo Univorsiteta Goologiya- 

(loograriya 

AimuMcai^ Journal of Agricultural Economios 

Fortuno 

Mining CoMgn?s,s Journal 

Population (Paris) 

Rovuo Goographiquo do lL*Est 

Ecoriomic Rotany 

Kconoinic History Ueviow 

FiJldra.j/i Krtosito 

Geographical Oiitlook (Huiu^hl, India) 
Journal of Tropical Geography 
Madagascar: Rovuo do Geographie 
Pakistan Development Review 
Pr/oglad Goograficzny 
A, I . D. C. Journal 

Business Review (Federal Reserve Bank of Philadelphia) 
Indian Forester 
Petroleum Review 
Polar Record 

Rivista di Agricoltura Subtropical' Ti^opicralr* 

Southeastern Geographer 

Albortan Geographer 

C:.lifornia Geographer 

Fonnia 

Goographie/Aardrijkskuni e 

Nauchnyo Trudy Tsontralny Nauchno-Issledovcaeliskxy 
I'lkon. Institut 

i>rohl. Ra/.vitiya Proizvodit sil Chxtinsk 
Jlovista do Statislica (Romania) 

Scioncc Reports, Tohoku Univ, 7th Sor, . Geography 
Turkiyo Iktisat Ga/.otosi 
Vie d' Italia o del Mundo 

Bollottin.; rj. iia Societa Goografica Italiana 
Commercial Fisheries Review 

F.A.o. Monthly Bulletin Agricultural Economics and 

tatist ics 
Geographical Magazine 
Akad Nawk SSSK Sor. Geog, 
Or ifn ta I Goograph^r 
Prol)lcmc> Kconomicc 
Sci(*ntific Amorican 
Asian Survc?y 

Hanca Nazionalo del Lavoro Quarterly Review 

liullotin of the Poak DiiUrict Mines Historical S(>ci««ty 

Ciirron iVi f a i rs Mii 1 li.»t in 

Iconomic G^^o^raphy (Moscow) 

Hurhw iy R(*SfN;rch R«?cord 

.Journal of Kcoiiomic History 

f>illook on Aj;riculturo 

Pc»lroIeum Tim«\s 

Soviet Studios 

Acta Coographica (Helsinki) 
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Number of Articles Title 



6 


Bulletin de 1' Association de Geographes Fran^ais 


6 


Comontt Limo and Gravel 


6 


Kast Midland Geographor 


6 


Dokumontacja Geograflozna 


6 


Ekistics 


6 


Fishin); Nows Intornational 


6 


Geographical Journal 


6 


Irish Journal of Agricultural Economics and 




Ru r a 1 Soc i o 1 oc v 


6 


Journal of the Institute of Petroleum 


6 


land Research Series (CSIRO) 


6 


^4auchnye Trudy Moskovskiy instituta Inzhenerov 




Zemleustroystva 


6 

w 


Norsk Hvalf angst-Tidende 


6 


Petermanns Geog. Mitteilt 


6 


ProdUktivite Verimlikik 


6 


Sociologla Ruralis 


6 


Statisztikai Szemle 


6 


Trudy-Azerbaidzhanskoe Geograf xcheskoe Obshchestvo 


6 


Unasylva 


6 


Vestnik Moskovsskogo Universiteta, Geografiya 


6 


Water and Water Engineering 


5 


Annales Universitatis Scientarum Budapestlnensis 




de Rolando Eotvos NominataOi Sectio Geographica 


5 


Czasopi/.mo Geograf iczno 


5 


Ekon. Geogr. Geogr. Prom-Sti 


5 


Folia Geographica. Ser. Geographica-Oeconomica 


5 


Geograf ichnyi Zbirnik L^Vivskyi Viddili 




Geograxichne Tovarystvo 




Geocrraf ski Glasnik ( Zacreb) 


5 


Geogr aphischo Zoi tschrif t 


5 


Izvestiya Sibirskogo Otdeleniya Akademii Nauk 




SSSR > Ser • Obschchos tvennykh Nauk 


5 


Izvetsja na Vishija Institut Zanarodno Stopanstvo 




I Varna ) 


5 


Journal of the Soil Conservation Service of 




New South Wales 


5 


Madcncilik 


5 


Prohloms of Economics 


5 


Proc. of the Hampshire Field Club and Archaeological 




Society 


5 


Revue Geographique des Pyrenees et du Sud Guest 


5 


Rovuo Juridiquo ot Economique du Sud-Ouest 


5 


Science and Culture 


5 


Studii si Cercotari de Geologie, Geofizicap 




GcografiOi Soria Goografie 


0 


Toks t Inaya Promysh lonnost 


5 


Town t Pd Country Planning 


5 


Unip^'do Paper 


5 


Yo:i/book of the Association of Pacific Coast Geographers 


^ 


Ac o*''!Oiiom 


^ 


American Industrial Development Council Journal 




Analele Univorsitatii Bucuresti, Geologie, Geografie 


4 
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4 
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4 
4 
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4 

4 
4 
4 
4 
4 
4 
4 
4 
4 
4 
4 

4 
4 
4 
4 

4 
4 
1 

3 
3 
U 
3 
3 
3 
3 
3 
3 
3. 
3 
3 
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3 
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lUillotln of Iiulonosian Economic Studies (Canberra) 
Doklady Instituta Goografix Sibiri i Dal*nego Vostoka 
Kconomic Journal 
Kconomies et Socio tes 
Kloctrical Hoviow 

Kociis 

F<il(irav/.i K<J/.loiftonyok 
GooKrafisch T i jUschr if t 
GooKraphical Analysis 

Indian Journal of Agricultural Economics 
Journal of the West African Science Association 
Journal, Statistical and Social Inquiry Society 

of Ireland 

Madcn Tolkik vo A rama Enstitusu Yayinx 

Mi?dilorranoa 
Midland Dank Uoview 
NaroUn, Kh-Vo Armonii 
Now Kngland Business Review 
NlRorian GooRraphical Journal 
Norsk Geogr, Tidskrifft 
Northern History 
Options Meditorrane'enes 
Oxford Economic Papers 

Uovuo Roumanio do Geologie» Geophysique et G6l>graphie» 

Sorie de Geographie 
Rivista Goo;^rafica 
Rybnoyc Kho/yaystvo 
Sevk vo Iciari Dorgisi 

SLudia Universitatea I3abes**0olyai Cluj, Geologia** 

Goographla 

Ti jdschr if t voor Vervoerswetenschapp^wi 
Trudy Tashkontsk. In-ta Inzh, Zh. Transp, 

World KishiHR 

\cta Univ('rsiiatis Carolinae» Geographica 
Agrarwirtschai t 
Amorican Kcomoiiuc Hoviow 

American Journal of Kconomics and Sociology 

Annals of And Zono 

Atom 

Austral ian Goo;;rapher 

Australian Instituto oi Agricultural Science Journal 
Australian Gtjo^. Sluflios 

Business Kf.»vi<nv (Fed. ilosorvo Dank of Dallas) 
Canadian Journal ot Agricultural liconomics 
Comer tul Modorn (Romania) 

Doklady i Soui.sfh^ ni^ a , Vses. Nauchno-Isslodovatoliskiy 
Inst. I'koM. Sol \sk, kh. 

DolclaJy Ot.'ioIfMUi i Kommissii, Geograf ichof^koe 

'>bshcho,stvo SSSil 
I'rononuc Dt.»voh>pmont and Cultural Change 
Tl o Kconomi.sl 
Kkonom i '^.kv C.mop i s 

L/hOKOduik, hScOnsKOo Gootrrafichoskoo Ol)Shchostvo 
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Title 

GcoRrnphor 

Godisnik no Sofijskija Unlvorsltett Coologo* 

Goo^rafski Pakultot 

Grands Amonac;omiints Rcglonuux 

Indian Economic Journal 

Irish Geographical Studies 

I/.v. Akad, Niuk A/erbaydxhanskoy SSR 

I/vestiya Zabatkal 'skii Filial Ceog, Obshch. SSSR 

Kdzgaxdasagi Szemle 

Monthly Review (Federal Reserve Bank of Minneapolis) 
Materialy Khar'kovsk Otd. Geogr. 0-VS Ukrainy 

Mining Engineering 

Nauchnye Zapiski Geograf Icheskoe Obshchestvo SSSR» 

Voronezhskii Otdo 1 , 

New Scientist %. 
Of f shore 

Pacific Viewpoint 

Proc. Inst. Elec, Eng. 

Regional and Urban Econoniics 

Regional Science Association Papers 

Review of Marketing and AgricUi.tural Economics 

Ri vista Geograf ica Italiana 

Scottish Journal of Political Economy 

Societe Gucrnesiaiso, Report and Transactions 

Studii si Corcotari do ralcul Economic si Cibernetica 

Kconomica 
Svensk Geograf isk Arsbok 

Transactions, Now York Academy of Sciences 
Uchenye Zapiski, Moskovskiy Oblastnoy 

Podagogicheskiy Institut 
Uchenye Zapiski Naucno-Issiedovateliskii Institut 

Pri Sovetsk Min. Chuvashk 
Universita Catiania Annali Delia Faculta di Economica 

e Commercio 
Weather 

A^r icu Itural Eoononiics Research 
Agricultural Science Review 
Agricultural Situation in India 
Agriculture 

Bulletin of the Mineral Research and Exploitation 

Institute of Turkey 
Business History 
California Management Review 
Canr^dian Geographical Journal 
Cored igion 

Chemistry and Industry 
Ciba Review 

Cop:rafya Arast irmalar i Dergisi 

Current Scono < Hon- Kong) 

Documontat i on Francaise 

East London Papers 

Econoiric Diillotin for Africa 

EFTA Bulletin 

Ekonomika Pol joprivred^ 

Ekonomika Radyans^koi Ukraini (Ekon. Sovetskoy Ukrainy) 
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2 
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2 
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2 
2 
2 
2 
2 
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2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
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2 



I'!mv i r>»iitiic'ri( .iiui iMnnninf; 

l-'itrm MiiuiKonu ti I (Molhoumu) 

Ptnancc ami ix.'volopmont • 

ForoiKn Affairs 

Ga/(lalkO(ias 

Ga/dasaK ^ 

GoOKraficky Casopis 

Goo{^rafiya (Sofia) 

Giornah.' Dojjli licouoraisti 

IKKE Papor 

IKKH Spoctrum 

Iiulustrialisalion aiicl Productivity 

Industry of Free Cliiria 

Institute of Transport Journal 

Int. Review of Administrative Science 

Izvestiya Vsesoyu/.nofjjo Geo[;ral'ichcskogo Obshchestva 

Izvestiya Vysshikh Uchobnykn zavedeniy GeodPziya 

i Aerofotos 'omka 
I/v. iia li.t 1 v;,! i>>kot() G' njirra I'Hko Diiix.estvo 
Japanese Journal of Geology and Geography 
Jerusalem Studios in Geography (1970- ) 
Journal of Common Market Studies 
.Journal of Iruhistrial Kcon>mics 
Journal of Political Economy 
Journal of tlio Institute of Fuel 
Journal Royal A^;ric. Soc. of England 
Laiidbouwkuiid i Ti,jdsc.»rift 
Land Rofonn (i'AO) 

Landw ir iHcliii ft -A^^;owandte Wissonschaf t 
I.upta do Clasa 
V.ana;^('moni. So k. iico 
r.uu'inors Mirj'or 
Midi'lo Fast Jo-., run I 

Mirovaya Hkonoinika i Mi.'/.lidiinarodnye Otnosheniya 
Molochiiaya Promyshlonnost ' 
Natura, Soria (ioo^^raf a-Geolot;io 
Natural R'-sou rocs Joiirnal 

Nauclinyo Ijoli l.uly Vyssl'.oy Slikoly, Kkonomichoskyo Nauki 

Nauchiivf /.ipiski Loninj^rads Finans. -I'.kon. Instilut 

Nf'tlicr I .wills Journal of Ajjr lou 1 1 uj'e Science 

N'uf.lf.ir I n,; 1 II 'IT I UK IiUcrnational 

t)l ('l) A;;r lOii I I'u a I li<-vn'w 

I\tkis'an ti( o;rr.4pIucal Itt-vicw 

I'api'rs and Proc. Uf..'i;ional Science Association 

Pap«.M's. Pcaop Ri'soarch Society 

PlioLo Int'M'pi i-'tat ion 

PI ;\novo Kl>o/yaysl vo 

i'oli.sl) Pf.'r.spt t iv(>s 

I'l' I roda 

I'roc'fvi I n-s . Royal Society, Victoria 
ProdUkt 1 V 1 1 <• 
Uaion Plaiurwvka 
Rf.'V ista G< <j,;ra i tCa 
llovuo d ' Aijv«'rgn(.< 



- (xiv) - 




Number of Articles Tit lo 

2 Rovuo Francaiso do 1 ^Agriculture 

2 Rivista di Economia Agraria 

2 Rural Africana 

2 ^ Sakliarnaya Promshlonnosty 

2 Scottish Fishories Dullotin 

2 Skandinavinska Danken Quarterly Review 

2 Social and Economic Studies 

2 Studii si Corcetari Economice 

2 Technical Bull. Washington Agric. Expt. Stn- 

2 Throo Banks Roviow 

2 Ti,ilschrift Holg. Ver. Aardr. Stud. 

2 Tourist Review 

2 Trans, of the Bristol and Gloucestershire 

Archoological Society 

2 Trudy Kishinovskii Politokhn. Institut 

2 Trudy Novosib. S-Kh. Instituta 

2 Turrialba 

2 Uchenye Zapiski Tartuskogo Universiteta 

2 Universita Cagliari Annali Delia Facolta di 

Economia e Commercio 

2 Universita Palermo Annali Delia Facolta di 

Economia v commorcio 

2 Vierteljahrehof te zur Wirtsohaftsforschung 

2 World petroleum 
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(ii) GEOGRAPHICAL ABSTRACTS: SECTION I) 

Number of articles contributed from serial titles covered, 
1970 and 1971 



Number of Articles 



Title 
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51 



'18 
•16 
'W 
43 

'12 
40 
37 
33 
33 
32 
31 
30 
30 
27 

26 

25 

25 

25 

23 

23 
•>•} 

w «^ 

21 
21 

20 

W) 
li» 
IS 

17 
hi 
l<> 

W 
i»i 
15 

* 1 

1-5 

i:i 

13 



Intornntional Yearbook ol Cartography 

lirbaiiisiiio 

Proceedings oX the Association o£ American 

CeoKriij)hei's 

Journal of the Town Planning Institute 

Population (Paris) 

Norois 

Annals of the Association of American 

Geographers 

Town Planning Review 

Soviet GcoKraphy, Review and Translation 
1 'Univorso 

Acta GooRraphica (Paris) 

Annales do Geographie 

Zeitschrift fur Wirtschaf tsgeographie 

Cartographic Journal 

Geographical Review 

Kevue de Geographic dc Lyon 

Transactions of the Institute of British 

Goograplioi's 

Bulletin de la Societe Languedocienne de 

Oeographie 

Goographische Rundschau 
Jovirnal of Keuiunai Science 
Terra 

Revue Geogrnpliiquc do 1 'Est 
Rural Sociology 
Califurnia Geof.:r;iphor 
MitLoLl. dor Ocsterr. Geog, Cos* 
Sociologia Rurnlis 

Vestnik LcningradsUogo Universi tcta • 

Goologiya-Geograf iya 

Kkislics 

GtMide?. i ya i Kartopraf iya 
Gooi^M-nphical Journal 
So ioncc 
Quale run ria 
V.ecii tf r ranee 

Ge(,^:raphii»/Aardri .ik.sk urr.le 
Gei,j:r;iphische ''.ci tschri ft 
Offici.il ArcLiLocturt :.ad lUanninj; 
I cliurr. r ipi.sk i PiT.'^.r.iv Ttu vcrsilot 
Ti id .ei.rift vuor Kci^ai, .a scho cn fiocialo 
:ra; 

( i.es) C.iiuers d'Oulre-Mer 

Trde 

Acta C«-iMrapUica (Uclbinki) 
(j u^traphy 

Jounuil oT Leisure Research 
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Number of Articles 



Title 
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1 *l 

X %^ 


1 A/«v•*^XilU VIV\/^4 ilJb XVA*4jr 


\*A 

X ^ 


Urbnti S tiidioH 






1 9 


fL'^ I nforma t icin GcoeraDhiCiUC 


1 •> 
1^ 












12 


Rovue Roumaulc dc Goolosile. GcophysiClUO 6t 






X X 


Hoiiottino dciin Socicta GcocroCica Italiana 


11 


Bulletin dc 1 'Association de Gcographes Francais 


X X 


rrpoi^fn nil i T Polonicxi 


t t 
11 


lyv Alport KoiiU SSSR Sor. GdOC^ 


X X 


Pol ni* RoCorrf 

ft %/A44ft tVwWwft V4 


X X 


Soc ioloLT ical Studios (Cambridixe) 


X X 


SoiitliGas tovn GcoiimDhei* 


XV/ 


«■ 4 %7 t« 


XV 


Chni^tcJi'od Siirvcvor 

%y ItCift W»4V V« h.f \% A VN^jrV* 


xu 


Eknnomichna Gcocrrariva. Mizhvldomchyl Naukovyl 




Zhlrkvk 


Xv 


Efiiflo*? Uiivnlos 

44 Ui4VtV'»3 1% V44 ttAVrf 


1 f\ 

iSJ 


Pho trip*!* Tnimo 1 1* i G R***C01*d 


xu 


Tnf ornnMonnl Journal of Environtnontal Studies 


lU 


npcri/iiinl Studios 


a 

*/ 


Albcrtan Gcofc;raphcr 




AntiCiuitv 


9 


OCOJJ* •* *- ^ J •* ^ ^ilKvJXU 


9 




9 




9 


I Opil 1 ti L 4 Oil <^ ulii* 1 1 


9 




0 


04>*i^i4^«j T**'~i't1i> pi 'If. nine 

oLUuxCh 111 r«4iiiiiy i xuuiixiiiy 


8 




8 


Geogror iCi'iy was<^pii-> 


8 


ucoprnpn ic ii X .■i.i>^»i^x4ic 




industrial /\rciiac;c»xiJ»,/ 


8 


T rkr»ni Pr^ntiiiMe^n Stiidios Mas^azirie and Xcwblottor 


8 


11 or 5 K vico^r • 4X\*?»u4xixc 


8 


Dii-icf-'iti ^W^i-ii* v'i ical RovIgw 

X il|VXOLt*tl VIV-«/f^4i.»|^44JL\rf»t4 *»\#V*%*»» 


8 


1 XclItllJLki^ •'i4w4V'Wl\ \" 


8 




8 


studia Goo'-'raDhica . Ccsk • Akad, Vcd, GcugraTxck 




V^^UliV 4^4 ilKJ 


8 


Studii si Corcetari do Geologic, Goofizica, 


GeoKt*nfiO| Scria GcoRrafie 


7 


Computer Contribution (State, Scol* Surv. Kansnf 




Univ. ofi 


7 


Current Affairs Bulletin 


7 


Kconomie Uuralc 


7 


Fortune 


7 


GeoRrcif isch Tijdschrif t 


7 


Population I?;vlcw 


7 


Uevue GcoK-- ujuo des Pyrenees ct du Sud Ouest 


7 


Voprosy Gci>j:> • ' i 


6 


Antarctic Journal of the U.S. 


6 


Asian Survey 


6 


Australian Geographer 



Hi 
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Number of Articloa 

a 

i\ 

a 

a 
a 
u 

0 

u 

G 
li 
5 
5 
5 

5 
5 
S 

5 
5 
5 
5 
5 
5 
5 
3 
5 
5 
5 
5 
5 
4 
4 
4 
4 
4 
4 

4 
4 
4 
4 
1 
4 

4 

4 
4 
1 




3 



TUlo 

Knviriininc'nt orul lUiUuUni: 
iithlojiiau Ck?ur,rapi»i^nl Journal 
Oi'ui;ra|)hic:il Anal y si H 
(icci|;i'a|)hical Uovicw oT Japan 

OllHhcllUHtVU 

Journal of Agricultural Kcouomica 
Journal oC Tropical Cgogrnphy 

Lanciscapo 

PrucoocUiiKS of the Prehistoric Society 
Science Uoporttt Tohoku University ^ 7th Hor. 

Gooi;raphy 

Town and Country Planning 
Vie U'uaia o del Mundo 
Aeromelf)<ly 
American Antiquity 

Analcle Univorsi tatii Uucurosti| Geologic, 

Geo^rnlie 

Archaeological Journal 
Arctic 

Computer Applications in the Natural and 

Social Sciences 
Kconomic Botany 
Economic History Review 

Fcauia 

Toldrajai Krtesito 
Goof^rnfsUi Glasnik (iiagz^ob) 
Modievnl Archaeology 
Haumforschuud u, Haumordnung 
Kovue Heipe Ceo*;r. 

Sociedado de Geografia do Lisboa Bolctini 

SocioloKia Sola 

Stcdebouw en Volkshulsvesting 

Sussex Archaeolof; icnl Collections 

Svensk Geografisk Asi.uk 

Archneologia Aeliana 

Archaeo? ogin Cnmbrcnsis 

Archaeolo|-:ia Cant iana 

Bohavinral Science 

Bolotin de la Sociodud Goograiica dc Colombia 
Doklady Instituta Geografii Sibiri i Dal'ncgo 

Vostoka 

Kconomic Goot^i^aphy (Moscow) 

Tolin Goo^rraphicn . Ser, Gcographica Oeconomica 
Forum. Stiinte Socialo 
Geografisk TidsskriTt 
P;ic i Tic V i i;wpoiat 

Proceed iiHTS of the Dorset Natural History 

and Archaeological Society 

Proceedings of the Hampshire Field Club and 

Archaeological Society 

Scientific American 

S tnt istica 

UNTSCO Courier 

America Indigena 
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Kuiaber uf Artioloa 

3 

3 
3 
3 
3 
3 
3 
3 
3 
3 
3 
3 
3 
3 
3 
3 

3 
3 
3 
3 
3 
3 

3 

3 

3 
3 
3 
3 
3 

3 
3 
3 
3 
3 

3 
3 
3 

3 



2 
2 
2 



2 
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Annlulo Stiintiricu Unlv«r»i(;atil Al. 1. Cu;fta 

Pin Inai, riooIonic-Gougrnf lo 

A.N'.Z. IJnnU Quarterly Survey 

lUulctyn Kotiiltcku Przo&itrzennogo Zogospoclarowua 

Uritisi) Wutor .Supply 

lUtilolin oT the Glinun Coog, Assn. 

Cumuniuari (to GcttKrnrio 

Dokumontac.j'i Gcoi^rariczna 
Econoi.iic Gcojtraphy 

Kzhci^odnlU EstonHUoc Ccogrof lohoskoe Obshohostvc 

Foldrn jzi Kozlvmonyck 

FordoriniKsdienst (Wion) 

Fotointorprctncja W Googrnfii 

Giunrraphical Outlook (Ranciii , Xndio) 

IV.V,\Z Trnas. Coosci. Eloctr. 

Izvcstiya Vysshikh Uchobnykh Zavedonly Goodczlya 
i Acrnfotos 'emko 
Journal of Geography 

Journal of the West African Science Association 

Moditcrranea 

Metorologiya i Gidrologiya 

N'atura, Soria Goograf io-Goologie 

Nauciuiyc Dokludy Vysshoy Shkoly, Ekonomichoskyo 

Nauki 

Nauchnyo Trudy Moskovskiy Instituta Inzhoncrov 
Zcmlous troys tva 

Nauchnyc Znpiski Googra£ichcskoe Obshchcstvo 

SSSU, Voronoishskii Otdol 

Oriental Geographer 

Pol ski Przoulnd Kartograf iczny 

Pracc Gcograficznc 

Priroda 

Pi'occcdings of the Lcathorhoad and District 

Local History Society 

Rochorchc (la) 

Rovuo d'Auvcrgno 

Revue do Geograpliio Marocaine 

Rivista Goografica 

Sbornik Nauchnyk Trudov, Porraskiy Politckh- 

nichoskiy Institut 

Social and Economic Studios 

Transactions . New York Academy of Sciences 

Yearbook of the Association of Pacific Coast 

Geographers 

Zcszyty Naukowc Uniwoisytetu Mikolajn Kopcrnika 
W Toruiiiu. Nauki Matemnt ....no-Przyrodaicze, 
GeoKra f iii 

Agrn - Eur, Presso Inf. Dionst 
American Scientist 

Annalvs Universitntis Scientarum BvidapostiucnHis 
de Rolando Eotvos Nominatac, Scctio Geot;rapliica 
Antinls of Arid iSone 
Arkhitoktura SSSR 
Australian Oeog« Studies 

Danco di Roma. Review of Economic Conditions in 



Title 



Uorluhtc Viber Iinndwirtschaf t 

Uul. Akaa. 8htint8o liHS MuIU« Izv. An Moia* 

tiiSIl Scr# Obshchostv. 

Uulletin ol ZnUonusian Kcoriomic Studios 

UuUotln or tho AtumlQ Scientists 

Cahicrs tlvs AmoriquoH Latiuos 

C;matli;m »Survuyor 

Cniissc\s ct Coveimos 

CiviliHatiuna (HruxcUos) 

CoiUMryu Arastirmalnri Dorgisi 

Cor.iMuni ly Development Journal 

EUonomiUa Sol*sUogo Kiiozyaystva 

GazdnlUodas 

Geographer (India) 

Geological Society of America Bulletin 
GiRlcna i Sanitariyn 

Godisnik na Sofijskija Universitot, Ceologo* 

GeoRrafski Fakultet 

History 

Innere Kolonizution 

Izv. Na, Balgarskoto Geografsko Druzestvo 
Journal of Geological Education 
KwartalniU Historii Kultury Matorianej 
Mining Congress Journal 
Modern Asian Studios 
Narodn, Kh-Vo Armenii 

Nauchnye iiapiski Lcningrads. Finans .-Ekon^ 

. Institut 
Nigorinn Geographical Journal 
Piici fio Viowpciint, Monograph 
Pakistan Development Review 
Photograiiruotria 
Photo- interpretation 
Problemy Arktiki i Antarktiki 
Proceedings ol tho Royal Society, Victoria 
Pr/.oglad Geodezyjn\ 

Pubiicaties van net Fysisch-Geograf isch en 
Bodemkundig Labora tori urn van de Vn. van 
Amsterdam 

Records of Buckinghamshire 

Recreation News Supplement 

Revue Goographique Alpine 

Revue Tunisionne do Sciences Socialcs 

Schr. Inst, Stadtcbnu Rauinordnung 

Schrif tcnroihc Flurboroinigung 

Schwoizorischo Zeitschrift fur Vcrmessung 

Sociologic A Historic Zcmedelstui 

S(>!::(;r:-iel Archac ■ i . :mM \.Ji!,r.il ||i.sii)r\ 

Studia Univcrsitatea Babes-Bolya, CluJ, 

Goologia-Geographia 

Surveying and Mapping 

Tebi»va 

Transactions of the Essex Archaeological Society 
Transactions of the Honourable Society of 
Cymmrodorion 

Transactions of tho Woolhopo Naturalists Field 
Club 



<xx) - 

Titles 

Tu**rlalbn 

Uchonyo iSnplsUi Dlngovoshch. Qosudarsvonnogo 
PodnKogsUogo Xnstitutn 

Uchcnye Zoplskl, Moskovskiy Oblastnoy Peclagogich- 
csUiy Xnstitut 

Uchcnye VSnpisUl Turkmen, Unlvcrsitota 

Univcrsltn Unrl Annoli Delia Faoolto di 

Economia e Commorcio 

Vestnik, Akadcmlya Xauk. 8SSR 

Vermoss.-Techiy. 

ha Vic Urboiii« 

Voprosy Crudes tr-V a 

Water Resources Research 

Weather 

Yearbook of the Cseohoslovak Academy of Sciences 



00 
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( I i i ) (iKUGHAPU 1 CAI. AilSTIlACT S : ' W?T I ON V 

Number of arttoUH contr ilmttMl \ vm soriul titles uuver<>d» 
1972 (iHHUcs (I) ami (2) 



Number ol articles Title 

28 ArfM 

Jciurnitl or iho Hoyui Town Planning Institute 
(tonm?rly, .loirnal of tho Town Planning 
liKstitu to) 

2*> Official Archt tc?cluro and Planning 

1^ Journal of I.oxsuro lvost*arch 

Socio-oconomic Planninj; Sciences 
13 Town anil Country Planning 

1 1 l'rl)anisini» 
1^ Profess J onal Gro^^raphor 

9 Knv ironm(>nt and annin« 

9 Informat lonon (Had Codes berg) 

9 Journal of i.ho Urban Planning and Development 

D' vision, ASCIi 
Sohr if icMin.»nio Siodlunj^sverband Ruhrkohlenbeairk 
8 Urban Studios 

7 ' Canadian (i»?o^j;rai)lior 

5 Journal of J{o|rional iScienco 

5 Municipal lUn'iow 

5 Water Kosourci^s Research 

Cahiors do Guo^raphic do Quebec 
'J Kconoiiuc Goography 

'1 K(Minia 

Goo^^raph ica] M i^a/.ino 
Goo^^raphisclie KunciscJiau 
'I Terra 

3 Advrncrmf»nt of Scionco 

^ jiiiil2ii lioma Heviow of the Kconomic Conditions 

i) Italy 

Hull. cU) la Socioto hpni^uodocionno de Geographie 
3 Dissorta* loti Abstracts Intornational, A 

3 Kconomio Rurale 

3 Grands Amona^:omf>nts Re^ionalos 

3 Pot^^rmanns Gco^raphischo Mitteilungen 

3 Planning Outlc^ok (N. Sor.) 

3 Hovuo do Goo^raphic? Alpino 

3 SbornU< Kkon Goografiya. Googr Prom-Sti 

2 Ainc Journal 

2 Anna 1 OS du Geographic 

- Annuls, As:>':»(; 1 ;i t ifjii of /Xmorican Goographors 

^ Kast Mid lancl Goo*;raphcr 

2 llconomic and Social Iloviow 

2 ♦ lirdkutulo 

2 Int. Labour Ueviow 

2 Irish Gooi;raphical Studios 

2 Izv. Vysshikh Jchobnykh Zavode Liy , <^tro itol 'Stvo 

Arkhi toktura 



Number of articlos Title 

2 Mater, SammU Agr. -So/iulogos 

2 MoUctololwSor Pra Goograi'lsk Institutt vod 

Norgos tlandolhojjskolo og Universitetet 

i Bo r gen 

2 Ucgional and Urban Economics 

2 Uovuo do Ciuographio de Lyon 

2 Uov, Econ, Soc. (Lausanno) 

2 Soviet Geography Review and Translation 

2 Trudy, Tallinskogo Botanicheskogo Sada 

2 Trudy Ural'skogo Politekhn In-ta 

2 Turkish Kconomic Review 



I Administration 

I Albertan Geographer 

1 Association of Pacific Coast Geographers > 

Yearbook 

I DuIIetin de L association des Geographes Francais 

I DuIIetin of the Illinois Geographical Society'^ 

I Can. J. Agric. Econ 

I Die Neue Ordnung 

I Ekonomika Sovetskoy Ukrainy 

I Erdo 

I Geo forum 

I Geograficky Casopis 

I Goografi\a (Sofia) 

I Geographical Journal 

I Geography 

1 GLC Intelligence Unit Quarterly Bulletin 

X Hommas et Torres du Nord 

I Iktisadi ve Ticari Ilimler Dergisi 

I Iktisat ve Mnliye 

I Industries et Travaux <5*0utre»Mer 

I International Journal of Environmental Studies 

X International Review of Community Development 

I Journal of Transport Economics and Policy 

1 Land Reform* Land Instrument and Cooperatives 

(Israel) 

I Meddolelser Egnsplanradet 

I Norois 

1 Notes. Etud Documentaires 

I Options Mediterranennes 

I Paysans 

I Progress in Geography 

1 Promyshlennost ' Armenii 

I Regional Studies 

I Reordenmento ( Luanda ) 

1 Rovue Geographique de L*Est 

I Revue do Gcographie des Pyrenees et du Sud Guest 

I Rivista Econ, Agr. 

X Science Journal 

X ^ Scottish Geographical Magazine 

1 Social Forces 

1 Stroitel *stvo i Arkhitektura 

1 Stroitel 'stvo i Arkhitektura Loningrada 

ERIC 
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Nuinborof articles 



Title 



Stroitol'stvo i ArUlj . t.< kUiru li/.lH'ia>*tana 
TuissUrift ior SarHfumisforskning 
Vxortoljahrslujf to /.uv Wirtschaltsrorschung 
Wator and Water KMginooring 

Zaplski VoronoKhskdgo Sol' skokhozyaystvo Instituta 
Zeltschrift /ur Wirtschaftsgeographio 
Zes/vty Naukowo Univeraytetu Lodskiego Nauki 
Ekononiiczne 
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APPENDIX £ 
BATH UNIVERSITY LIBRARY 
EXPERIMENTA INFOKMATION SERVICE FOR PLANNERS 

QU.'iSTIONNAIRE 

• 

Now that you have seen the Experimental Information Service for 
Planners we would very much like to hear your views on it. It would help 
our research enormously if you would complete the following questionnaire. 

Please mark one box only for each question except where otherwise 
.indicated. 



1. 



Name; 



2. 



Code No; 



3. 



Employing organisation (Include name of department* section, 
branch » etc. ) 



4. 



Please list your qualifications which are relevant to planning. 



5. 



Nature of work: (mark as many boxes as applicable) 

practice 



teaching 
research 

6a« Do you subscribe to, or use, Geo Abstracts' ^ 

regularly 
occasionally 
no 



6b. 



ERLC 



Do you uce regularly any other information service? 



yes 



no 



If *yes' plc^ase name; 



* - (XXV) - 



HOW did you use the Experimental Servico you rocoivoU? 



read thoroughly 
scanned through 
glanced at 
did not use 



FREQUENCY OF ISSUE 



a. Do you think you received issues 



too frequently? 



at about the 

right frequency? 



not frequently 
enough? 

If 'too frequently* or 'not frequently enough*, please 
suggest reasons for your reply; 



c. How frequently would you ideally wish to receive issues? 



weekly 

fortnightly 

monthly 

every 2 months 
quarterly 



ENTRY FORMAT 



a. Did you find the inclusion of keywords in each entry 
adequate for assessing the relevance of material in the 
service? 



not adequate 
sometimes adequate 
completely adequate 



b. Would you have preferred abstracts? 



yes 
no 



c. Would you have been satisfied with titles alone? 



yes 
no 



Please give any further comments you have about the amount 
and adequacy of information in each entry: 



This page only was included in the questionnaires which were sent 
to planners who received styles with keywords. 
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i:ntry format 



a* PuJ viUi fir ih«» abslruots: 



not aduqtialf)? 
surnel imus aiUM{ualo? 
oomplotuly udoquatu? 



Would you hav»' lnM.Mi s«4tisriiMl with titlos alono? 



no 



WcHild yn\i havf' ho**?^ satisfioc! by ritb»s with added keywords 
(by 'keywords* \v<.* moan wur<is indicating the subject ol 
ihe art icl»0? 



ves 



no 



Plc»ase givp any further comments you have about the amount 
and adequacy of information in each entry: 



This pa^o only was included in thi- questionnaires which were 
stMU lo planners who received styles with abstracts. 



KNTRV FORMAT 



a. Did you find titles alono adequate for usaossing tho 
relevance of material in the service? 



not adequate 
sometimes adequate 
completely adequate 



b« Would you hav^ preferred abstracts? 



yes 
no 



c. Would you have preferred titles with added keywords 
(by ^keywords' we mean words indicating the subject 
of the article)? > 



yes 
no 



d. Havr you any further comments about the amount and 
adequacy of information in each entry? 



This page only was included in the questionnaires which were 
sent to planners who received styles with titles only. 
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INDEX 

Author imiox 

a« Did you uso the author inUux? 

yos 
no 

b. If you did not use the author index was this because 

you did not need to? 
it was not easy to use? 

Ploase state any other reasons; 
Subject iudox 

c. Did you use the subject index? 

yes I 
no 

d. If you did not use the subject index was this because 

you did not need to? 
it was not easy to use? 

Please state any other reasons: 

e» Would ycu have preferred any other type of index? 

yes 
no 

f. If 'yes', please explain what type you would have preferred: 

This page only was included in the questionnaires which were 
sent to planners who received stules with an index* 



INDEX 



a. Would you have found an index useful? 



yes 



no 



b. If yes, which of the following types of index would 
you have used? 



author 
subject 
geographical 
keyword* 



significant word appearing in the titles of the entries 



This page only was included in the questionnaires which were 
sent to planners who received styles without an index. 
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II, NUMBER OF KNTHJKS 

•I. Did you find tho numhor of (MUrios in oauh issuu 

too fow? 



about r i^lH? 



luQ) many? 



12. 



tH)VKHAiJt: 



a. WoulU you have liked tfu» service to cover 



mow journals? 

more books? 

m()ro reports or 
other semi -published 
materials? 



fowc»r journals? 

fewer books? 

fewer reports or 
other semi-published 
materials? 



(mark as many boxes as ttppropr iate) 



b. Did you find the amount uf toroign lHn«ua*j;e material 
covered 



too little? 



about right? 



too much? 



c. Please give any other comments you h-ivs about the choice 
of Items covered; 



I3a. Taken as a whole do you rate the Experimental Service which you 
have received as 

of no use to you? 
of little use? 
moierately useful? 
very useful? 
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I3b. How do you think thut the Exporimentul Service oould be improved 
to make it of more use to you? 



I4a. 



Would you subscribe to the Experimental Service if it were to 
become fully operational? : 



yes 



no 



I4b. If you were to subscribe, how much per annum would you be 
prepared to pay for a personal subscription? 

up to i:2«50 
£2.50 - £5,00 
£5.00 - £10.00 
£10.00 - £15.00 
£15.00 - £20.00 
more than £20 



(NB Answers to this question will not of course commit you to 
buying any service that is introduced ) 



15. Without increasing the cost of an indexing or abstracting Journal, 
it is not possible to have ideal coverage^ abstracts , frequency 
of issue, etc. all together. In practice, an increase in frequency 
may mean poorer coverage, and full abstracts or indexing may mean 
a decrease in frequency. 



a. Would you prefer: 

a publication issued once a fortnight, with 
rudimentary indexes and no abstracts? 




or 

a publication issued every two months with 



h. Would you prufi^r: 

a piitil ioat ion issutni c)nc«.* a fortnight hut 
with wry Umitoii cnvi»ra>;<*? 



or 



a puhlicalion issutMi m'ory two months hut 
wilh ii with* covtTaa<»? 



Would yi>u prt»l't»r; 

u puhlication with widf covoruj^o hut no ahstructs? 
or 

a puhlication with a limitfui ovorago hut Kood 
uhs tracts? 



16. If the hasic publication was issued every two months, with 

reasonal)le covera^^e and good abstracts and indexes, would you 
be prepared to pay extra for an additional publication, issued 
fortnightly, consisting ol titles only, with keyword indexes? 



yes 



no 



17. Please make a?iy other comments >'^>ii wish about any aspect of 

the Kxperimental Information Service for Planners; 



Please return this questionnaire to Mr. J.M. Hrittain, DISISS Pro.jt^ct, 
Library, Bath University, Claverton Down, Bath, BA2 7AT, in the envelope 
provided . 

If you still have any of the *'mark up** sheets which were at the front 
of each issue of the? Experimental Service, please return them, even 
if you had nothing to record. 

Thank you for your help. 



University of Bath 
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(i)* .ii|i)ot ln(i)fm«ition Systems 
II) the Sociiit Sciences) 



LiUrory 

Cidvorton Down 
Bath BA2 7AY 



Ptoit'Ct Hood; M«iuriCc Line 

Seniot Research Fellow; Mtchaot drittain 



Toiophono Bath 6941 
TeieK 449097 



Doar Sir/MaUam, 

This is the last issue of the Experimental Information Service 
for Planners. I hope that you have found it of some value and that 
you will be able to assist us with evaluation, partly by filling in 
the tear-off sheets at the front of each issue and partly by completing 
the questionnaire* 

I would bo pleased if you would return the tear-off sheets and 
the questionnaire together in the pre-paid addressed envelope within the 
next throe weeks. If at the end of three weeks you are still trying to 
obtain copies of items, please return the questionnaire and tear-off 
sheets as soon as you have obtained all these items. 



Again, thank you for your help. 




Michael Brittain 
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DtSiSS RciOiUCh Projoct Library 

(Design of Information Systems Ciaverton Down 

in the Social & icnces) fiath BA2 7AY 

Project Head: M.uirtce Line Telephone Bath 6941 

Senior Research f ellov/; Michavl Brttti^n Telex 44D097 



APPENDIX F ^ETTKU ASKING PLANNERS TO PARTICIPATE IN THE EXPERIMENT 

14 July 1972 



An essential part of our programme of research into the design 
of information systems is the setting up and evaluation of a real-life 
information service. We have decided to operate an experimental 
service for planners; this will be run in conjunction with Geo Abstracts > 
vho have recently produced a new section - Section F, Regional and 
Community Planning* 

We shall produce a number of different versions of Section F 
of Geo Abstracts, varying frequency of issue, journal coverage, length 
of abstract, etc. and we are hoping to got the cooperation of about 
200 persons in all fields of planning. We shall bo pleased to send, 
free of charge, for a period of 6 months, one style of publication to 
each person who is willing to participate. 

I should bo very pleased if you would agree to participate in 
this experiment: I would ask you only to give your comments on each 
issue, and at the end of the experimeni to fill in a short questionnaire* 

I should be grateful if you would pass this letter to your 
colleagues, or let me know the names and addresses of other persons 
willing to receive the experimental issues and participate in our 
Gxpoi iment . 

The first experimental issue would be available towards the end 
of October, although we liope to be able to keep in contact with you 
between now and then. 



Yours sincerely. 




Michael Brittain 
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